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ABSTRACT 


Many  types  of  phenomena  are  investigated  by  being  observed  at  a 
large  number  of  successive  points  or  successive  time  intervals*  ..All 
observations  are  subject  to  error;  and  it  frequently  happens  that. the 
errors  of  successive  observations  are  such  that  the  inferred  velo- 
cities, accelerations,  or  the  like,  are  wholly  incredible  as  a result 
of  these  errors  of  observation*  In  cases  of  this  sort  some  process 
of  smoothing  is  a necessity;  and  even  where  no  absurdity  is  obvious  a 
smoothing  process  may  be  highly  desirable*  This  means  a process  by 
which  each  observed  value  is  altered  slightly  so  as  to  bring  it  into 
reasonable  relations  with  those  that  precede  and  follow  it*  In  this 
there  are  obviously  two  conflicting  aims,  (a)  to  achieve  reasonable 
smoothness,  and  (b)  to  alter  the  observed  data  by  reasonably  small 
amounts*  The  purpose  of  this  report  is  to  present  a method  hy  which 
these  two  conflicting  aims  are  more  effectively  reconciled  than  by 
any  previously  used  method* 
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Construction  and  Selection  of  Smoothing  Formulas 


1*  Nature  of  the  Problem 

The  general  problem  of  smoothing  consists  in  tire  determination 
in  the  most  plausible  manner  available  of  the  values  of  a function  Relieved 
to  have  Borne  simple  form  of  regularity  or  ’smoothness',  when  this  regularity 
has  been  obscured  by  the  fact  that  the  values  of  the  function  which  are 
supposed  known  have  been  determined  by  an  imperfect  method  which  may  alter 
each  one  by  some  unknown  error.  These  errors  are  assumed  to  have  a random 
distribution.  Their  source  need  not  be  explicitly  specified.  They  may 
arise  as  errors  of  observation,  or  as  an  accumulation  of  errors  of  computation 
such  as  rounding  errors,  errors  due  to  omission  of  small  terms,  etc.  A 
typical  source  consists  in  the  accidental  errors  occurring  in  a sequence 
of  runs  on  the  Differential  Analyzer  or  other  analog  machine.  The  values 
originally  obtained  by  the  imperfect  method  will  be  called  the  original  or 
crude  values,  and  the  values  by  which  we  replace  these  as  more  plausible, 
the  smoothed  or  adjusted  values.  The  difference  between  a crude  value  and 
the  corresponding  adjusted  value  will  be  called  a residual.  We  shall  limit 
our  consideration  here  to  entries  listed  against  only  one"  argument,  and 
shall  further  assume  that  the  values  of  this  argument  are  equally  spaced, 
and  hence  may  be  taken  without  loss  of  generality  as  consecutive  integers. 

2.  Tabular  Differences 

The  criteria  that  we  shall  apply  for  the  smoothness  of  a sequence 
will  be  expressed  in  terms  of  tabular  differences.  The  notation  to  be  used 
for  these  will  be  as  follows.  The  original  values  will  be  called  uq,  u^,  Ug, 

— — , where  uQ  may  be  either  the  first  entry  in  the  sequence  or  some  entry 

at  which  we  wish  to  begin  consideration.  Successive  tabular  differences 
will  be  written  as  follows* 

^ - vui-i 

V -A^-A^u 

. n * am 

zv  “Ziju-zji^u 
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The  tabular  difference  of  any  order  is  defined  in  terms  of  differences  of 
the  next  lower  order.  It  may  therefore  be  ultimately  expressed  in  terms 
of  values  of  the  function.  Thus 

A"  u - V2ui-1  + Ui-2 
Ai'u  *•  ur>ui-i + 3ui-2“ui-3 


and  in  general, 


(j)  0.  1 

A « • '>  bJ:  Vk, 
k-0 

where  the  coefficients  arc  the  binomial  coefficients  with  alternating 

signs,  namely 

-3  _ c-l)k  31 
bk  * rg-|TJ-k)i 


If  the  sequence  u consists  of  the  successive  values  of  a polynomial  o,f  degree 
m,  it  is  well  known  that  its  tabular  differences  of  degree  m + 1 are  equal 
to  zero.  If  the  values  of  a sequence  are  in  some  interval  approximately 
equal  to  the  values  of  a polynomial,  then1  the  differences  of  some  order  may 
be  expected  to  be  small.  ¥e  take  then  the  criterion  of  smoothness  that  the 
tabular  differences  of  some  order  shall  be  small;  and  the  process  of  smoothing 
must  tend  to  decrease  on  the  whole  the  magnitudes  of  the  tabular  differences 
of  some  order.  Practically  all  sequences  that  we  shall  deal  with  will  have 
the  following  characteristics.  The  numerical  values  of  the  first  order  differ- 
ences are  smaller  than  those  of  the  values  of  the  function,  the  second  order 
differences  smaller  than  these,  and  so  on  for  a certain  number  of  orders. 

For  any  one  of  these  orders  the  values  fall  into  consecutive  groups  of  several 
values  each,  having  one  algebraic  sign,  within  the  group.  For  higher  Orders 
the  numerical  values  increase  with  the  order,  and  in  any  order,  not  more  than 
two  consecutive  values  keep  the  same  sign.  If  we  think  of  the  order  for 
which  the  numerical  magnitudes  are  least  as  m + 1,  then  we  may  regard  the 
sequence,  at  least  in  some  limited  neighborhood,  as  approximately  represented 
by  a polynomial  pf  degree  m.  If  the  differences  of  order  m + 1 are  small, 
the  sequence  approximates  closely  to  the  values  , of  a polynomial  and  may  be 
regarded  as  smooth.  If  these  differences  are  not  small  the  process  of 
smoothing  is  one  that  tends  to  diminish  their  magnitudes.  If  we  take  m as 
determined  by  the  sequence  in  the  manner  just  described,  then  any  procedure 
for  smoothing  3mist  be  such  that  if  applied  to  a polynomial  of  degree  m it 
will  leave  its  values  unchanged. 


3.  Smoothing  Methods 

The  use  of  a smoothing  formula  is  only  one  of  the  possible  methods 
of  smoothing.  Ey  a smoothing  formula  is  here  meant  a formula  by  which  the 
adjusted  vaLue  of  any~entiy  isr' obtained  as  an  explicit , funct ion  of  the  crude 
values  of  a limited  number  of  entries  in  the  neighborhood  of  the  one  in 
question.  The  use  of  such  a formula  may  be  contrasted  with  curve  fitting  in 
that  the  latter  makes  use  of  all  the  entries  in  a sequence,  in  adjusting  any 
one,  whereas  a smoothing  formula  uses  only  those  in  a certain  neighborhood. 
In  curve  fitting  also  a form  of  function  must  be  selected  in  advance  which 
has  one  or  more  parameters  to  be  determined  to  produce  the  best  fit  to  the 
given  sequence.  In  smoothing  by  formula  no  such  selection  is  necessary. 
Smoothing  by  formula  may  also  be  contrasted  with  smoothing  * by  eye  * in  that 
the  whole  operation  is  summed  up  in  one  substitution  in  a formula  for  each 
entry,  rather  than  consisting  of  successive  operations  each  dependent  on 
the  results  of  the  preceding  ones. 
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ii«  Characters  of  the  Formulas 

Every  smoothing  formula  considered  will  have  the  form  of  a linear 
homogeneous  function  of  the  values  of  the  neighboring  entries.  These  entries 
will  be  confined  to  those  whose  arguments  differ  from  that  of  the  entry  to  be 
adjusted  by  not  more  than  a certain  number  n,  which  will  be  called  the  spread 
of  the  formula.  Except  for  entries  within  n steps  of  the  beginning  or  end 
of  the  sequence,  the  formula  will  then  involve  2n+l  entries,  the  one  to  be 
smoothed  and  n entries  on  each  side  of  it.  With  the  exception  noted,  the 
entries  other  than  the  one  to  be  smoothed  occur  in  pairs,  the  two  members  of 
a pair  having  arguments  equidistant  from  that  of  the  entry  to  be  smoothed. 

In  all  such  symmetric  cases  the  formulas  will  also  be  symmetric,  that  is 
they  will  have  equal  coefficients  for  the  two  entries  of  any  such  pair. 

If,  however,  the  entry  to  be  smoothed  is  within  n steps  of  the'  beginning  or 
end  the  formula  can  not  be  symmetric  as  a whole,  and  the  symmetry  of  the 
coefficients  does  not  apply.  This  case  will  for  the  present  be  excluded 
from  consideration.  A method  for  dealing  with  entries  near  the  beginning  or 
end  of  a sequence  will  be  discussed  in  paragraph  -IS*,  In  addition  ■ tp'xthe 
spread  n we  shall. use  another  parameter  m,  called  the  order,  and  defined  as 
follows^  If  a smoothing  formula  is  applied  to  a sequence  all  of  whose  entries 
are  equal,  it  is  clear  that  the  formula  should  reproduce  these  equal  values*. 

If  a smoothing  formula,  when  applied  to  the  successive  values  of  a polynemial 
of  degree  m,  reproduces  those  values,  but  fails  to  reproduce; the  values  of  a 
polynomial  of  higher  order,  then  the  formula  will  be  said' to  be  of  order,  m. 

!?•  Principal  Objects 

The  objects  of  this  paper  are  to  obtain  for  various  given  values  of 
n and  m those  coefficients  which  shall  make  the  formula  in  each  case,  a practical 
optimum,  and  to  formulate  a criterion  for  selecting  a suitable  value  of  m 
for  the  smoothing  of  any  particular  sequence*  A criterion  for:  n is  much  more 
difficult  to  obtain,  since  the  value  of  n determines  the  amount  of  smoothing, 
and  this  may  depend  on  whether  a certain* peculiarity  in' the  crude  values  is 
regarded  as  merely  an  irregularity  to  be  smoothed  out  or  a genuine  indication 
of  a characteristic  of  the  function.  As  regards  the  first  problem  it  is  nec- 
essary to  specify  what  the  criteria  are  for  an  optimum.  In  general  it  is 
desirable  that  the  residuals  shall  remain  small.  This  is  the  criterion  of 
fidelity.  It  is  even  more  desirable  that  in  any  neighborhood  not  too  small 
they  shall  have  a random  distribution  with  a mean  approxiraatr’y  equal  to 
zero.  This  is  a criterion  for  avnidancs-olr  bias  f Obviously  one  important 
criterion -of  merit  in  a s mo othing  forrr.uia  is  the  attaining  of  smoothness. 

More  concretely  this  is  the  diminution  of  the  numerical  magnitudes  of  the 
tabular  differences  of  some  order.  The  amount  of  this  diminution  may  be  called 
the  criterion  of  power.  For  selections  of  coefficients  which  are  of  substan- 
tially equal  merit  from  the  foregoing  points  of  view,  there  may  be  differences 
in  the  ease  of  evaluation.  This  may  be  spoken  of  as  the  criterion  of  conven- 
ience. Of  these  four  desiderata  ve_jKsy;  regard-  the  avoidance  of  bias  as  the 
most  important.  Clearly  a glaring  fault  in  a smoothing  formula  would  be  that 
it,  should  make  a systematic  shift  in  one  direction  of  any  considerable  number 
of  consecutive  entries.  It  may  be  shown  that  the  avoidance  of  this  evil 
depends  entirely  on  the  selection  of  m.  Fidelity  and  power  are  somewhat  in 
conflict.  For  a given  value  of  m,  an  increase  in  n will  increase  power 
but  is  likely  to  decrease  fidelity.  In  fact  for  a given  value  of  m we  may 
proceed  to  one  extreme  by  taking  n - 0.  This  gives  maximum  fidelity  since 
there  is  no  smoothing  and  hence  every  residual  is  zero.  On  the  other  hand  we 
may  proceed  to  the  other  extreme  by  talcing  n large  enough  to  include  all  the 
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entries  in  the  sequ?;nce.  The  coefficients  could  then  be  chosen  so  as  to  , replace 
all  the  entries  by  the  values  of  a single  polynomial.  This  would  give  perfect 
smoothness,  and  hence  maximum  power,  but  might  produce  large  residuals  and 
hence  poor  fidelity.  For  given  values  of  m and  n the  principal  problem  is 
to  select  the  coefficients  to  obtain  maximum  power.  Selection  on  thi3  basis 
doe3  not  appear  to  militate  against  fidelity.  In  general  the  criterion  of 
convenience  should  cone  last.  It  may  appear  as  a small  modification  of 
coefficients  which  have  been  determined  as  optimum  from  some  form  of  the 
criteria  that  have  been  mentioned. / 


6.  Conditions  on  the  Coefficients  to  Secure  a Specified  Order 


From  the  preceding  we  see  that  a smoothing  formula  of  spread  n may 
be  written  in  the  form 


• n 


CjUi+j  * 


(1) 


where  u^  is  the  original  value  of  an  entry  and  IF  is  the  smoothed  value . If 

we  require  the  formula  to  be  of  order  m this  imposes  certain  conditions  on 
the  coefficients  c ..  The  definition  of  m requires  that  U .*»  u.  when  the  values 
of  u^  are  those  of^a  polynomial  of  degree  m.  Let  this  polynomial  be 


m 


u 


i+j 


k**o 


V 


Then  u.  « a , and 
i o 


n 


m 


U.  ■ 21  c . 'ey~  a.  = u.  « a 
i r““_  j fe  k . i o 


(2) 


n 


j=«-n  " k»o 

« k 

Ip  this  sum  the  coefficient  of  a.  is  5"  C4J  '.  Since  in  (2)  the  coefficient 

j=-n  5 

of  is  1 and  that  of  every  other  is  zero  we  have  as  the  conditions  for  the 


order  m that 


and 


n 


—r,  J 

»-n 


c . ■ 1 


n 


j»-n 


e/  - 0 


(3) 


U) 


when  0<k^m,  This  makes  m+1  conditions  imposed  upon  2n+l  coefficients  3 ince 
we.  are  excluding  entries  within  n steps  of  the  beginning  or  end.  Hence  if 
m>2n  there  is  no  solution.  If  n*»2n  there  is  one  solution  which  is  readily 
seen  to  be  cq=1,  Cj**0  when  j^O.  This  gives  U.^u.j.  regardless  of  what  values 

u^  has,  and  hence  provides  no  smoothing.  Therefore  to  obtain  an  actual  smoothing 
formula  we  must  have  2n^m.  We  have  noted  that  the  coefficients  are  made 
symmetrical,  that  is  This  results  in  (}j)  being  satisfied  automatically 

for  every  odd  value  of  k.  Thus  formulas  are  always  of  odd  order,  at  least  as 
far  as  this  specific  condition  is  concerned.  We  shall  subsequently  derive 
further  conditions  which  will  distinguish  between  second  and  third  order. 
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between  fourth  and  fifth,  etc*  It  should  be  understood,  of  course,  "that 
the  coefficients  in  the  formula  do  not  vary  with  the  argument  of  the  entry 
being  smoothed.  Thus  does  not  vary  with  i.  The  conditions  (3)  and  (U) 

imposed  on  the  coefficients,  cince  they  are  linear  relations,  may  be  solved 
if  desired  for  certain  of  the  coefficients  and  the  results  substituted  for 
these'  explicitly,  leaving  a smaller  number  of  independent  unknown  coefficients 
to  be  determined  by. the  application  of  other  conditions. 

7.  Polynomial  of  Best  Fit 

We  shall  now  discuss  a method  commonly  used  to  complete  the  determin- 
ation of  the  coefficients,  and  the  reasons  for  not  using  this  method.  The 
method  consists  in  finding  .coefficients  which  will  give  a smoothed  value  of 
the  central  entry  considered  which  is  equal  to  the  value  at  this  central  point 
of  that  polynomial  of  degree  m which  is  the  best  fit  for  the  2n+l  entries 
used.  In  speaking  of  the  best  fit  we  may  understand  this  in  either  one  of 
two  ways.  The  usual  way  is  to  regard  all  2n+l  entries  as  of  equal  weight.  , 

This  involves  the  logical  contradiction  that  in  determining  the  smoothed 
value  of  an  entry  we  restrict  our  attention  to  these  2n+l  entries,  presumably 
because  they  are  nearer  than  the  others  which  we  ignore,  and  yet  we  make  no 
distinction  among  those  we  use,  in  spite  of  the  fact  that  some  are  much 
nearer  than  others.  On  the  other  hand  we  may  avoid  this  contradiction  by 
giving  the  2n+l  entries  unequal  weights,  the  greatest  weight  being  assigned 
to  the  entry  being  smoothed,  and  the  weights  decreasing  from  this  to  rela- 
tively small  weights  assigned  to  the  outermost  entries.  In  this  case  it 
remains  to  determine  the  exact  assignment  of  weights.  For  example  the  binomial 
coefficients  might  be  regarded  as  a plausible  selection,  or  some  set  of  weights 
based  on  the  probability  function.  There  are  other  more  desirable  selections 
than  these;  but  we  shall  prefer  here  to  proceed  upon  a principle  more  explicitly 
related  to  what  may  be  plausibly  regarded  as  the  main  advantage  of  unequal 
weights.  The  error  in  the  crude  value  of  any  one  entry  makes  a contribution 
to  the  smoothed  value  of  each  of  the  2n+l  entries  which  contain  it.  If  the 
weights  in  the  formula  are  equal,  this  contribution  .suddenly  jumps  from  zero 
to  a certain  value,  remains  fixed  at  this  value  for  2n+l  entries,  and  then 
suddenly  disappears.  VJith  unequal  weights  its  contribution  is  first  small, 
then  rises  gradually  to  a maximum  and  gradually  decreases.  Thus  each  error 
contributes  in  a relatively  smooth  manner  to  the  final  result,  and  we  do 'not 
depend  nearly  so  much  for  the  final  smoothness  upon  the  errors  balancing 
each  other  locally.  Since,  in  addition  to  its  logical  superiority,  a merit 
of  unequal  weights  consists  in  attaining  greater  smoothness  than  that  given  ' 
by  equal  weights,  it  seems  preferable  to  seek  this  greater  smoothness  more 
directly  and  explicitly. ' This  will  be  done  in  the  following;  but  a digression 
will  be  made  here  to  discuss  the  significance  of  order* 

8 . Characteristics  of  the  Order  of  a Smoothing' Formula 

If  the  graph  of  the  smoothed  function  (assumed  to  give' approximately 
the  true  values)  is  a curve,  then  the  effect  of  smoothing  by  a formula  of  order 
one  is  in  general  that  of  fitting  a straight  line  to  a group  of  2n+l  points 
distributed  along  the  curve  or  near  it,  and  taking  the  value  at  the  central 
point  on  this  line  for  the  smoothed  value.  If  the  curve  has  no  inflection 
point  in  the  interval  considered,  this  procedure  has  the  effect  of  bringing 
the  smoothed  point  to  the  concave  side  of  the  curve.  The  straight  line,  being 
chosen  to  give  small  residuals  for  all  the  2n+l  points  U3ed  (by  minimizing 
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the  sum  of  their  squares ),  Is  likely  to  give  residuals  systematically  of  one 
sign  near  the  middle  of  the  interval,  and  of  the  other  sign  near  the  ends, 
these  'residuals ' referring  of  course  merely  to  the  determination  of  the 
particular  straight  line  and  not  to  the  smoothing  as  a whole.  The  general 
effect  Is  to  put  all  the  smoothed  points  on  the  concave  side  of  the  true 
curve,  and  thus  introduce  a systematic  bias  over  any  interval  in  which  the 
curve  continues  concabe  one  way.  If  we  use  a formula  of  order  two,  we  are 
attempting  to  fit  a parabola  to  the  points.  This  will  avoid  the  obvious 
type  of  bias  just  mentioned,  but  may  leave  a bias  not  so  easily  obvious, 
that  is  some  tendency  for  the  residuals  to  remain  entirely  or  predominantly 
of  one  sign  over  some  considerable  interval.  This  is  an  indication  that  the 
order  used  is  still  too  small.  We  have  indicated  in  Paragraph  2 a method 
for  determining  m so  as  to  eliminate  bias.  If  this  value  of  m is  used, 
m+1  conditions  are  imposed  on  the  coefficients.  The  remaining  coefficients 
may  then  be  determined  with  a view  to  obtaining  maximum  smoothness.  Since 
the  order  m+1  is  the  lowest  for  which  the  magnitudes  of  the  differences 
are  due  mainly  to  the  roughness  rather  than  to  the  true  values,  the  remaining 
degrees  of  freedom  are  used  in  an  endeavor  to  diminish  the  magnitudes  of  the 
differences  of  order  m+1.  The  method  for  this  will  now  be  discussed. 

9.  Further  Conditions  on  the  Coefficients 

We.  shall  now  assume  that  the  order  of  the  formula  used  is  sufficient 
to  avoid  appreciable  bias.  This  means  that  the  true  vaLues  of  the  function' 
can  be  represented  with  sufficient  accuracy  by  a polynomial  of  degree  m in  the 
interval  extending  n steps  on  each  side  of  the  value  in  question.  How  it  is  • 
a property  of  a polynomial  of  degree  m that  the  differences  of  order  m+1  of 
its  values  at  equal  intervals  shall  be  zero.  • Let  us  write 


where  - 1^  denotes,  the  true  value  of  the  function  and  e^  the  error.  Then  with  • 
sufficient  accuracy  we  shall  have 


(m+1) 

A±  t - 0. 


Let  us  express  differences  of  all  orders  in  terms  of  the  values  of  the  original 
function  by  means  of  the  appropriate  coefficients,  as  in  Paragraph  2.  Then 


U - 


u, 


i-k 


m+ 

» ^ 

; b,”*1  k 

o j*>-n 

m+1 

m+1 

n 

- Z 

k*o 

bk 

cjVk+j 


m+1 


m+1 


k«o 


j£»  v-h* 
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The  first  of  these  sums  is 


m+1 


ra+1  n^r  4.  V*  . m+1  . <-  • i(mfl)  + 


which  Is ’equal  to  zero  to  the  approximation  that  we  have  used*  Consequently 
we  have  approximately 


n 


m+1 


rn  CJ  ei-k+j. 


This  is  the  expression  which  we  desire  to  minimize  in  general  for  any  particular 
values  of  m and  n in  order  to  achieve  an  optimum  set  of  values  of  the  coefficients 
Cj.  It  is  a linear  homogeneous  form  in  the  random  variables  e^_jc4.j»  and  hence 

will  in  general  be  a minimum  if  the  stun  of  the  squares  of  the  coefficients  of 
these  variables  is  minimized*.  Now  a particular  variable  e^_r  has  the  coefficient 


m+1 


m+1 


'k-r 


For  the  optimum  selection  of  coefficients  the  sura  of  the  squares  of  this 

expression  must  be  minimized  for  all  relevant  values  of  r.  Since  r*»k-J  the 
extreme  values  of  r will  be  -n  and  n+m+1*  We  shall. thus  obtain  in  general  the 
smallest  values  of 


A 


(m+l) 


U and  hence  the  optimum  coefficients  Cj  if  we 


require  that 


n+m+1 

r=-n 


m+1 


u m+1 
bk  ck-r 


r- 


a minimum 


(5) 


subject  to  the  requirements  (3)  and  (U)  of  paragraph  6 for- maldng  the  formula 
one  of  order  m.  In  equation  (5)  the  summation  indicated  will  give  certain 
values  of  k-r  outside  the  limits  -n  and  n.  For  these  there  will  be  no  values 
of  the  coefficient  c.  » This  will  present  no  difficulty  if  we  merely  define 
the  coefficients  Cj  "r  as  being  zero  whenever  j ^n  , and  determine  non  zero 

values  for  the  others.  In  this  condition  for  a minimum  the  coefficients 

b^+^  are  known,  whereas  the  coefficients  c^_r  are  unknowns  to  be  determined 

subject  only  to  the  conditions  already  imposed.  These  latter  may  be  used  to 
eliminate  one  or  more  of  the  unknowns  and  the  indicated  sum  minimized  as  a 
function  of  all  those  that  are  left.  It  is,  however,  much  more  convenient  and 
systematic  not  to  perform  these  eliminations,  but  to  set  up  criteria  for  satisfy- 
ing all  the  conditions.  It  may  be  noted  that  no  explicit 'criterion  of  fidelity 
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is  introduced.  It  can  be  seen,  however,  that  the  procedure  indicated  tends  to 
insure  a measure  of  fidelity  for  the  following  reason*  If  m is  chosen  so  as 
to  eliminate  bias,  the  smoothed  values  in  any  interval  not  too  small  will  be 
bracketed  by  the  crude  values*  This  tends  to  make  them  lie  as  near  to  the 
crude  values  as  is  consistent  with  smoothness* 

10*  Formulation  of  the  Conditions 

The  problem  just  formulated  is  that  of  minimizing  a certain  function, 
as  given  in  (5),  subject  to  the  fulfilment  of  certain  conditions  namely  those 
given  in  (3)  and  (h)«  This  problem  is  a special  case  of  a general  one  formu- 
lated as  follows.  It  is  required  to  minimize  the  function  <P  (x^,  Xg,  — , xr) 
subject  to  the  s conditions  given  by  the  equations  ' 

F±  (3^,—  xr)  - o 1 - 1,  2,  — a 

where  s<r.  It  is  a well  known  theorem  (cf.  Goursat,  Cours  d? Analyse  §61*) 
and  easy  to  prove  that  a necessary  condition  for  this  is  the  vanishing  of  all 
the  (s+1)  row  determinants  in  the  matrix 

^F1  ^F1  ^F1 


' " - - 


For  the  oases  considered  here  this  condition  may  be  replaced  by  the  vanishing 
of  those  determinants  whose  columns  are  consecutive.  For  the  particular  problem 
the  arguments  x^,  •*•  xp  become  c_n,  ••*,  cn*  The  partial  derivatives  are 

3 F1  - 1,  ^ F2  - i',  3^3  - i2,  ^ - im  i 

9°!  9c±  go± 

The  function  d>  is  that  given  in  (5»)  namely 


From  the  symmetry  assumed  for  the  coefficients  c_n,  •••  cn,  ek_r  may  be  replaced 

by  o v*  The  bracket  then  becomes  a tabular  difference  of  order  m+1  of  the 
r~K 


ii 


sequence  of  coefficients  c_n,  •••,  cR  and  we  may  write 

n+m+1  / * (m+l)\  2 

f (c_„,  ...  cn,  . £ (4  ) . ... 

where  A'  a"  — denote  tabular  differences  of  the  coefficients  c . — — c . 
"r;  t -n  n 

r 

The  last  row  in  the  matrix  consists  of  the  successive  values  of 


If  " 2 

d 15  i Ml 


n+m+l  ml  , m+1 

2 bk  cr-kbr-i  * 


This  may  be  written  with  the  more  restricted  range  of  summation 

i+m+1  m+3 


3*1 


, m+1  , m+1 

bk  br-i  cr-k» 


m+1 


since  outside  this  range  br-^  ■ o.  To  order  this  according  to  the  values  of 


cr-k*  leb  8 ° r“k*  ;Then  we  have 


TeJ- 


i^1  & .m+1.  m+1 

cs  bk  bs-i+k  * 

s«i-m-l  3 k=o  K 3 1JC 


A well  known  theorem  on  binomi&l  coefficients  states  that 


» C 


P+1 

q+J> 


and  it  is  easy  to  see  that  a similar  theorem  except  for  a sign  applies  to  the 
coefficients  b that  are  used  here.  It  follows  then  that 


2 


i+m+1 


(-1) 


m+1 


3“i-m-l 


, 2m+2 
s -i+m+1 


2(~1) 


m+1 


A 


(2m+2) 


..  i+m+1 


The  necessary  condition  for  the  required  minimum  therefore  is  the  vanishing 
of  all  the  (m+2)  row  determinants  of  the  matrix 


1 

-n 

(-n)2-  - - 

- (-n)m 

(2raf2) 

^-n+rofl 

1 

-n+1 

(-n+1)2-  - 

- (-n+l)m 

/i  (2m+2) 

^-n+m+2 

2 

m 

(2m+2) 

1 

n 

n - - - 

- n 

A 

n+m+l 
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where  the  rows  and  columns  have  been  interchanged  merely  for  convenience 
of  writing.  Or  we  may  write 


1 

i-2m-2 

(i-2m-2)2 - - 

--  (i-2m-2)m 

j2m+2) 

^ i-m-1 

1 

i-2m-l 

(i-2m-l)2--  - 

- (i-2m-l)m 

(2i»2) 

^i-m 

— 

— 

— 



■* 

1 

i-m-1 

(i-m-1)2  --  - 

(i-B-l)” 

. (2m+2) 

Aj 

with  i - -n+2m+2,  -n+2m+3>-— -j  n+m+1.  To  evaluate  this  wo  may  replace 
the  elements  of  the  last  row  by  that  linear  combination  of  this  row  and 
the  preceding  rows  which  will  give  in  each  column  the  difference  of 
order  m+1  in  that  column  regarded  as  a sequence,  then  replace  the  elements 
in  the  next  to  the  last  r&w  similarly  by  the  differences  of  order  m,  and 
so  on.  This  will  give  (3uh-3) 

A.  as  the  last  element  in  the  last  row. 


a numerical  constant  in  each  of  the  remaining  elements  in  the  principal 
diagonal  and  a zero  in  each  element  below  this  diagonal.  The  necessary- 
condition  for  a minimum  then  finally  becomes  (3ro+3) 

A , - 0 for 


i«-n+2m+2,~  — n+m+1,  where  the  differences  are  those  of  the  coefficients 
c^  regarded  as  a tabular  sequence,  with  the  understanding  that  » 0 if 

2 2 

i , and  that  One  very  significant  feature  of  this  result 

consists  in  the  range  of  values  of  i where  it  is  applicable.  The  coefficient 
c.  is  zero  by  definition  if  9 9 

1 i > n , but  the  vanishing  of  ™ ' 

occurs  for  at  least  one  difference  at  each  end  of  the  sequence  that 
involves  one  of  these  zero  coefficients,  in  fact  for  a number  of  them 
at  each  end  equal  to  m+1.  This  fact  is  basid  in  the  technique  of 
determining  the  numerical  values  of  the  coefficients. 


11*  Case  Where  m » 0, 

For  this  case  ^ ^ » 0 when  -n+2  K n+l«  This  la^lies 
that  c^  may  be  expressed  as  a quadratic  in  i,  which  from  the  symmetry 
of  the  coefficients  may  be  written 

ci  " aii  +ao 

when  -n-1  ^ i^n+1.  From  the  vanishing  of  c^+^  we  get  at  once 

p 

(n+1)  + aQ  ■ 0 or 

.i-aji*-  (n+1)2]  . 
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Thus  the  coefficients  are  determined  except  for  the  constant  factor  a^* 

This  may  be  determined  by  (3)  namely  the  condition  that  the  sum  of  the 
coefficients  is  equal  to  unity*  In  this  and  all  similar  cases  it  is 
sometimes  practical  to  take  the  constant  factor,  here  a^,  entirely  at 

convenience,  and  to  divide  the  results  so  obtained  by  the  sum  of,,  all 
the  coefficients.  In  this  case  we  take  ■ -1  and  write  J'  ' 

* (n+l)2  - i2 

with  the  understanding  that  the  results  of  using  the  formula  thus  produced 
are  always  to  be  divided  by  the  sum  of  the  coefficients*  Thus  for  n - 1 
we  have 

UQ  » (3u^'+  Uuo  +3^)  ♦ 10 

For  n «*•  2, 

UQ  ■ (5u_2  + 8u^  + 9uq  + 8^  + 5^)  + 35 

Using  merely  detached  coefficients  we  may  write  for  n ■ 3 
(7  + 12  + l5  + 16+  15  + 12  + 7)  «*  8U 

For  n - U 

(9  + 16  + 21  + 2U  + 25  + 2U  + 21  + 16  + 9)  ♦ 165 

For  n ■.  5 

(11  + 20  + 27  + 32  + 35  + 36  + 35  + 32  + 27  + 20  + 11)  ♦ 286 

and  so  on  for  any  n. 

12 . Use  of  the  Binomial  Coefficients 

Before  proceeding  to  larger  values  of  m,  we  may  observe  that 
from  the  analogy  of  the  preceding  we  may  expect  to  have  to  perform  six 
summations  or  finite  integrations  for  m * 1,  nine  for  m *2  and  so  on* 

Now  altho  we  proceeded  vdthout  difficulty (»  the  simple  case  where  m “ 0 
by  expressing  c^  as  a polynomial  in  i,  we  shall  find  that  finite  differ* 

ences  and  more  particularly  finite  summations  are  handled  much  more 
easily  if  and  its  successive  differences  are  expressed  as  a sum  of 

multiples  of  binomial  coefficients  instead  of  a sum  of  multiples  of 
powers,  i.e.  if  we  deal  with  terms  containing  . . 

Cj  rather  than  i . Wq 

shall  use  a definition  slightly  more  general  than  the  binomial  coefficient 
proper,  namely 


where  j is  a positive  integer  but  i may  be  any  integer.  Further  let 
= 1 for  any  i and  Cj  ■ 0 if  j<10  for  any  i*  From  (6)  vie  have 

Cj«01f  O^Kj. 


1U 


Also 


(-1)J  C 


i nJ-i-l 


From  the  definition  we  may  readily  derive 

C*+*  " ci  i “ ci* 

j+1  j+1  J 


If  we  call  this 


j 

f\  we  can  also  write 


(7) 

(8) 


k+1 

>1 


(9) 


It  is  clear  that  (8)  and  (?)  are  vastly  easier  to  use  than  the  corresponding 
formulas  for  differences  and  sums  of  powers,  particularly  the  latter  which 
involve  Bernoulli  numbers  or  their  equivalent.  In  any  case,  at  each 
successive  step  of  integration  an  unknown  additive  constant  must  be  intro- 
duced. In  half  the  cases  this  may  be  readily  found  as  follows.  From 
the  symmetry  of  the  coefficients,  Hence 

A „i  ° c_i  - c-i_i = ci  ■ ci+i " " Aw 


Likewise 

n A n A»u  . hi 

A_i  " A1+2»  A1+3  ^ in  general 


(10) 


This  combined  with  (7)  gives  an  equation  involving  , the  constant  of  inte- 
gration. In  half  the  cases  this  determines  its  value.  In  the  other 
half  it  is  merely  an  identity,  and  the  constant  must  be  found  otherwise. 


There  is  one  feature  of  the  binomial  coefficients  which  is  not 
so  simple  as  that  for  powers.  If  the  smoothing  coefficients  c^  are  ex- 
pressed as  a polynomial,  their  symmetry  which  makes  c^  ■ c_^  is  provided 

by  merely  omitting  the  odd  powers.  With  binomial  coefficients  vre  may 
proceed  as  follows.  The  essential  feature  is  that  the  symmetry  reduces 

the  number  of  parameters  to  determine.  This  may  be  accomplished  by 
joining  two  binomial  coefficients  in  a fixed  pattern.  Let  a difference 
in  c^  of  any  order  be 


+ £ 


i+p 

q-1' 


or  a sum  of  multiples  of  such  quantities 


A(!l 


j-i  - • 


. Then 

- =&*p 
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3y  (7)  this  becomes 


A - <-i)q(a - c1"3-p+q"2) 
q q-i 

. (-i)q[a(c1'J-p*'1-2  ♦ c1- J-p^q-2 

q q-1  q-1  J 

. (-l),faC1"-,"p*']*2  . <a-l)  Ci-3-Pn-2] 

q q-1  J 


But  by  (10) 


/^J)  - (-D3  AU)-  <-DJ  (aCn+P+  Ca+l) 

J-l  i q q-1 

•A(J) 

These  two  expressions  for  A will  be  equal  if  a ■ 2 and  2p  - q-J-2, 

j-1 

A(J) 

The  terms  which  make  up  will  then  have  the  form 

i 

2C^  P + C**p  with  2 p ■ q-j-2 

vl 

13*  Case  Where  m ■ 1,  We  start  here  with  A ■ 0 when  -n+li<i$n+2, 

Av  1 

From  this  A is  a constant}  but  the  constant  is  zero  by  (10),  so  that 

/\V  a o when  -n+3^i^-n+2*  Thus  the  highest  order  non-vanishing  difference 

1 < 

AiV 

is  . Since  this  is  a constant,  writing  it  in  the  form  Just  derived  requires 

that  q « 0.  Hence  p ■ -3  and 


Av  , , 

when  -n+2<i^-n+2 


Then  in  succession 


A m 

■ ^^C^*2  + C*'“2)  when  - n+l^i<n+2 
/\”  - ag(2  C^”1  + C*"1)  + 2a1C^“2  when  -n^i^n+2 


y\*  - a2(2C^+  C2)  + a1(2ci“1+  Co"1)  when  -n-l^l^a+2 


i-1  . „i-l> 


0±  » a2(2C^+1  + C*+1)  + (2C^  + C*)  + 2aoC^~A  when  -n-2^i<n+2 

lh.  General  Procedure,  We  shall  now  seek  a procedure  applicable  to 
any  value  of  m«  The  general  expression  for  any  order  of  difference  of  the 


,i  . -i 
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coefficients  c •••*  c is 
-n  n 


(C 


i+k-j-l 
2 k-j-1 


1 


2C 


i+k-3-lx 
2k-J  ; 


i 


(U) 


holding  when  -n+j-m-1^  i^  n+m+1,  The  summation  extends  from'k  '■  0 to  an 
upper  limit  depending  on  m,  the  limit  being  given  by  the  relation  2k^3m+2 
This  may  be  seen  by  noting  that  the  highest  order  difference  which  may  be 
different  from  zero  is  j ■ 3m+2,  The  second  term  in  the  parenthesis  in 
(11)  then  has  the  lower  index  2k-3m-2  and  this  must  be  zero  to  make  this 
term  a constant.  Of  course  terms  with  smaller  values  of  k are  introduced 
by  the  successive  integrations* 


Putting  3*0  gives 


c,  - 


rci+k-l  - J+k-1, 
(C2k-l  + 2C2k  } 


(12) 


holding  when  -n-m-1  S i < n + m + 1,  Summing  once  more  with  respect  to 
i gives 

«i  ' ? ak  ^ <«> 

The  meaning  of  is  the  sum  of  the  coefficients  beginning  at  some  fixed 
point  in  the  sequence  and  ending  with  c^*  To  determine  the  fixed  point 
we  may  observe  that  b “2a  but  a - a * Hence  the  sum  begins  with  half 

O O 0 0 

of  the  middle  coefficient*  This  makes  the  sum  of  all  the  coefficients 
equal  to  2a  » 


15,  Determination  of  the  Additive  Constants,  In  order  to  evaluate 
the  expression  for  c^  it  remains  to  determine  the  values  of  aQ,a^.,,  the 

number  of  these  depending  on  m»  When  m ■ 0,  there  are  only  the  two,  aQ 


and  a^,  and  two  conditions  are  needed  to  determine  them.  For  larger 

values  of  m there  are  more  constants  and  correspondingly  more  conditions. 

For  all  values  of  m we  have  the  condition  2d  "1*  The  expression  for 

holds  up  to  i - n+m+1,  but  b.  ■ 0 if  i > n.  Hence  we  have  the  conditions 
C‘n+^  * 0,  cn+2  ■ 0,  ..  ■ 0,  Further  conditions  arising  from  equation 

(h)  remain  to  be  formulated,  but  entfbr<'  for  the  first  time  only  when  m«2. 

In  the  following  no  upper  limit  will  be  indicated  for  k in  the  sums  used,  so 
that  the  equations  written  may  be  used  for  any  value  of  m by  extending  the 
values  of  k suitably.  On  the  other  hand  elimination  will  occur  of  certain 
terms  with  small  values  of  k,  or  these  terms  may  be  written  separately,  and 
the  notation  V"  , , ) will  be  used  for  sums  in  which,  0,  1,  2,  ... 

0 1 2 

respectively  is  the  smallest  value  of  k.  In  all  such  sums  also  the  letter 
a with^u^  subscript  will  be  used  for  ak,  Although  the  two-term  expression 

for  /\  is  well  adapted  for  the  summation  process,  it  will  usually  be 
i 
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convenient  for  algebraic  purposes  to  make  use  of  the  transformation 


<£  * 2 c"  , - iESii  Cp  . 

q q+1  q+1  q 


CiU) 


Of  course  this  la  not  applicable  when  q ® -1.  We  have  then 


c » 2 a + 


ai  pi+k-l 


o 


•rin.id  a c‘;k 
1 o 7TE51  dK 

For  the  actual  evaluation  of  the  coefficients  c. 


perhaps  the  most  convenient  form* 

,2 


2a  + 
0 


[ai  + 7X  (a2  + FF  [*3 + far 


(15) 

(16) 


the  following  is 


For  particular,  values  of  i this  becomes 


°o  ■ ?a0 

el  ■ cl  ■ Jao*  *1 

“*  ■ e-2  ■ 2ao*  Ual*  *2 

c - c - 2a  + 9 a.  + 6 a.  + a_ 

3-30123 

Ci  ■ c , ■ 2a  + 16 a.  + 20 a„  + 8 a,  + a, 

U -U  o 1 2 3 U 

- 2 aQ  + 25  a^  + 50  * 35  a,  + 10  a^  + a^ 

tt6  " d 6 " 2a0  + 36  a^  + 105*2  + 112  a^  + 51*  a^  + 12  a^  + a^ 

c?  - C^  » 2aQ  + h9a^+  196  a2  + 291*  + 210  a^  + 77  a,,  + llta^  + a^ 

Cg  ■ c g ■ 2 aQ  + 61*  a^  + 336  a.^  + 672  a^  + 660aj^  + 352  a^  + 10l*a^+  l6a^  * 

- c_p  - 2aQ  + 81'a^  + 51*0*2  + 1386  a^  ♦ 1782  aj^  + 1287  a^  + 51*6  a^  + 135  a^  + 

c,_  * 0 m-2a  + 100a,  + 825 a.  + 26l*0a_  * l*290a,  + l*00l*a_,  + 2275a,  + 800a_  + 

10  -10  o 1 2 3 1*  5 o 7 

cu  - c_u-2aQ  + 121  a^  + 1210  a?  + 1*719  + 9l*38a^  + 11011  a^  + 8008a6  + 371*0  a?  * 

a12  " 0 12~^ao+  3-1*1*  a^  +'  1716  ag  + 8008  a^  + 19305  a^  + 271*56  a,,  f 21*752  a^  * 11*688  a^  + 

with  the  understanding  that  the  formulas  stop  with  a..  when  m ■ 0,  with  a when 
m - 1,  with  a,  when  m • 2,  with  a^  when  m ■ 3t  with  when  m ■ U,  etc.  It 
remains  to  determine  the  values  or  a0,a^, for  -various  values  of  m and  n, 

16,  Details  for  Various  Values  of  m.  For  any  value  of  m we  have  the  two 

equations  2a  -l  and  c - 0*  From  these  we  may  write 
n i n+i 
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r - * _ 1 


- z 


« „n+k  . V(afl> 

5k  + 1 C2k  ao  ZT 


n+k 

+ yTroiC2k  * 


n+1 


2a 


- 0 - 


n+] 


+ a1(n+l)  + F £ C,  ; 


„ nPl-6Po-  -3  >2  ao  V(n+l)(n+2) 

Q1  • THTJ-  - T^YJCSri+TJ  ■ TffT  * ~Z— 


y a(k-l) 

^-jErew: 


,n+k 


(n+l)P..-2Prt 
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When  m - 0,  k <2,  and  hence 

a ■ 3 (n+1)  , a,  ■ 

2(2n+lH2n+3)  1 Tn+l)(2n+lK2n+3) 

When  m > 0,  we  have  the  additional  condition 
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Before  proceeding  further  it  is  convenient  to  introduce  a notation  for  certain 
types  of  products. 

Let  q(x,y)  - x(x+lj(x+2)...(x+y-l), 

r(x,y)  - x(x+2)(x+U)...(x+2y-2) 

Thus  q(x,y)  and  r(x,y)  each  denote  a produot  of  y factors  of  which  the  first 
is  x,  the  successive  factors  increasing  by  1 in  the  case  of  q.f  and  by  2 in  . 
the  case  of  r.  With  this  notation  we  continue. 
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When  m - 1,  k <3,  and  hence 
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When  m > 1,  we  have  two  additional  conditions, 

C • 0 and  or  ■ / i2  W ■ 0,  The  former  gives  ue,  in  the  same  manner 
n 3 i-1  1 

as  before, 

2‘  - n+k+2 


P . J21 J .0.-4+  . (n+3)  ♦ y Z Cn*k+ 
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In  order  to  utilize  the  summation  properties  of  the  binomial  coefficients 
we  make  the  following. tranefoimation  in  evaluating  o' 
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When  m • 2,  .k<C5,  and  hence 
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By  exactly  similar  methods  one  may  obtain  the  results  for  m ■ 3 and 
ro  ■ U.  The  algebraic  details  are  rather  tedious  and  will  be  omitted  here. 
The  results  are  as  follows.  For  m ■ 3, 
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17*  Tabulation  of  Coefficients.  The  values  Just  given  and  those 
previously  obtained,  when  substituted  in  (15)  or  in  the  enumerated  special 
cases  which  follow  (16)  give  the  numerical  values  of  c^  for  iz  n , n ^ 12, 

and  m They  furnish  smoothing  formulas  of  degree  up  to  the  fourth  and 

spread  up  to  25  entries  (n  = 12).  They  are  tabulated  in  two  forms,  Tables 
1 to  5 labeled  as  "Data  Multipliers  (Exact  Values/1  and  Tables  6-10  labeled 
"Data  Multipliers  (Decimal  Approximations)".  Since  these  last  are  approxi- 
mations it  is  not  to  be  expected  that  they  will  satisfy  exactly  all  the 
theoretical  conditions.  The  value  of  cQ,  however,  has  been  adjusted  so  that 

the  coefficients  in  all  cases  satisfy  condition  (3)  namely  the  requirement 
that  their  sum  be  unity.  This  may  be  regarded  as  the  most  fundamental  re- 
quirement. The  values  are  given,  to  9 decimals.  This  is  a convenient  number 
for  the  large  electronic  machines.  It  means  that  for  all  practical  purposes 
they  are  exact.  If,  however,  it  is  desired  to  use  the  coefficients  with 
ordinary  desk  calculators,  the  use  of  so  many  decimals  is  unduly  laborious, 
and  mere  rounding  to  a small  number  of  decimals  will  in  general  destroy  the 
conformity  to  the  theoretical  conditions.  Since  the  bias  thus  introduced 
could  conceivably  be  significant  it  is  recommended  that  if  these  tables  are 
reduced  to  a small  number  of  decimals  the  procedure  be  as  follows.  For 
» • 0 or  m > 1,  equation  (3)  is  the  only  condition  necessary  to  consider. 

In  these  cases  we  may  take  the  ordinary  rounded  values  of  ...  @n  and  find 
the  central  coefficient  as 

c - 1-2 
o 


For  m - 2 or  m - 3 we  must  also  satisfy  equation  (h)  with  k - 2.  We  take 
then  the  rounded  values  of  Cg  •••  «n,  write 


(18) 


U we  must  also  satisfy  equation  (U)  with 

k = U.  If'in  this  equation  we  substitute  k - 2 and  k - U and  eliminate 
we  get  n 

- * m * ZL  i2(i2-l)c.  (19) 


and  f ind  c from  (17).  For  m 
o 

U. 


‘12  T=T 


In  this  case  we  take  the  rounded  values  of  and  substitute 

successively  In  (19),  (10),  and  (17).  In  equations  (17)  and  (18)  the 

coefficients  are  obviously  integers.  In  (19)  they  are  also  integers  since 


i2(i2-l)  is  devisible  by  12  for  any  integer  value  of  i.  Hence  the  sub- 
stitution in  these  equations  involves  no  rounding  and  the  results  satisfy 
them  exactly.  In  order  to  keep  the  changes  in  the  central  coefficients 
a3  small  as  possible  it  may  be  feasible  to  exercise  some  Judgement  in  the 
rounding  of  the  outer  ones.  For  example  for  m ■ n ■ u,  straight  -irounain^ 
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pounding  to  four  decimals  would  give  cQ  - .1*976,  ■ .30l;6,  c2  » -.0063, 

■ -.0677,  and  *•  .0206.  If  we  accept  these  values  of  and  and 

compute  the  others  we  get  c^  - -.0058,  - .3029,  and  cq  - .5000.  On  the 

other  hand  if  we  use  ■ -.0676,  we  get  c2  ■ -.0061;,  » »30UU,  and 

c - .1*980,  which  are  much  nearer  to  the  exact  values.  The  reason  is  as 
o 

follows.  The  six-decimal  values  are  c^  ■ -.067688  and  ^ “ .020621;.  In 

the  first  case  the  rounding  of  c^  and  o^  gives  respective  alterations  of 

-.000012  and  -.000021;.  In  (l5)  these  ar©  multiplied  by  the  coefficients 
-6  and  -20  and  give  an  alteration  of  .000552*  In  the  second  case  the 
alteration  in  is  made  + .000088.  Now  although  this  is  larger  than  before 

it  gives  an  alteration  in  c2  of  only  -,0000l;8.  A little  juggling  of  this 

sort  may  diminish  appreciably  the  alterations  in  the  central  coefficients, 
which  may  become  considerable  for  the  larger  values  of  n.  The  technique 
is  to  select  the  rounded  value  of  first  and  select  in  succession  the 

•rounding  of  c , c «...  so  as  to  prevent  the  building  up  of  a large 

alteration  in  c2» 

18.  Entries  Near  the  Beginning  or  End.  We  have  noted  that  a formula 
of  spread  h cannot  be  applied  within  n steps  of  the  beginning  or  end  of  a 
sequence  because  of  the  absence  of  some  of  the  terms  oalled  for.  It  Is 
theoretically  possible  to  derive  special  asyinmtrical  formulas  to  cover  these 
oases.  They  require,  however,  greatly  increased  labor  both  in  derivation 
and  in  use.  The  following  procedure  appears  adequate  to  deal  with  the  values 
near  the  ends.  Whatever  method  may  be  used  for  selecting  n for  the  body  of 
the  table,  it  need  not  be  regarded  as  inviolable.  For  a value  near  enough 
to  either  end  to  call  for  an  entry  outside  the  table  with  the  regular  value 
of  n,  we  shall  simply  uso  a value  of  n enough  diminished  to  avoid  this  dif- 
ficulty. In  general  we  may  continue  to  use  the  regular  value  of  m.  However, 
we  may  not  diminish  n so  far  as  to  make  2n£Sw,  since  then  there  will  b©  no 
smoothing.  When  this  occurs,  m may  be  decreased  also,  being  taken  equal  to 
2n-l,  When  this  is  dona,  each  entry  of  tile  sequence  is  smoothed  except  the 
end  one,  where  the  original  value  is  left  unchanged.  There  are  many  tables 
in  which  the  leading  entry  le  definitely  fixed  (often  at  zero).  The  method 
just  described  is  boot  adapted  to  these  daaos.  If  an  end  entry  is  not  fixed 
in  this  way,  the  following  method  may  be  better,  Let  n be  (diminished  as  the 
end  is  approached  as  long  as  Sn^m.  The  remaining  values  may  then  be  filled 
in  by  taking  as  constant  the  tabular  difference  of  order  m. 

19*  Comparison  with  Standara  Hot hods  - Numerical  Example.  In  Table  11  le 
given  a set  or  o&serve 5 valuea  a'tT  qua ri er  second  intervals  of ' so-oalled  7 angles 
in  the  flight  of  a certain  projectile*  These  are  angles  In  degrees  at  one  station 
to  ba  combined  with  a similar  set  from  another  station  to  give  the  orientation  of 
the  projectile  axis.  The  table  also  gives  tabular  differences  up  to  the  fifth 
order.  The  next  six  tables  (12-17)  give  the  results  of  smoothing  these  values  by  six 
different  methods,  each  likewise  accompanied  by  five  orders  of  tabular  differences, 
and  by  the  residuals.  The  first  three  of  these  tables  make  use  of  a spread  of  11 
values  (n*5),  and  the  next  three  of  a spread  of  25  values  (n»12).  In  each  of  these 
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groups  of  three  the  first  and  second  are  based  on  a standard  formula  of  the 
type  in  common  use  and  referred  to  in  Paragraph  7 as  undesirable.  In  Tables 
12  and  1$  the  degree  is  3 5 in  Tables  13  and  16  the  degree  is  5.  The  final 
table  in  each  group  (lii  and  17)  is  based  on  the  methods  developed  in  this 
report  with  the  degree  m-3.  The  relative  characteristics  of  the  several 
smoothing  methods  are  summarized  in  Table  18.  To  indicate  relative 
fidelity  standard  deviation  is  recorded  for  each  method,  namely  the  root 
mean  square  value  of  all  the  residuals.  To  indicate  the  smoothness  obtained, 
the  root  mean  square  value  of  each  order  of  difference  is  recorded  for  the 
original  values  and  for  each  method  of  smoothing. 

In  order  to  make  an  unbiased  comparison  of  the  different  methods  the 
same  number  of  values  for  any  particular  kind  of  quantity  is  included  in  the 
mean.  Thus  there  are  73  observed  values  here  recorded;  but  applying  an  eleven 
point  smoothing  formula  to  these  gives  63  smoothed  values,  and  a 2?  pt.  formula 
U9  values.  Accordingly  only  U9  values  are  included  in  the  residuals,  H8  in 
the  first  differences,  U7  in  the  second,  and  so  on. 

Let  us  first  compare  the  power  of  the  standard  formulas  for  different 
orders  and  different  spreads,  that  is  the  measure  of  smoothness  obtained  as 
'indicated  by  the  dinimition  in  the  mean  values  of  the  tabular  differences. 

In  no  case  is  the  first  order  difference  greatly  diminished*  For  all  higher 
orders,  however,  the  diminution  is  very  notable.  Comparison  of  the  different 
values  shows  that  the  smoothing  power  for  the  same  spread  is  greater  for  the 
third  order  than  for  the  fifth,  but  for  the  same  order  it  is  greater  for  a 
23>  point  spread  than  for  an  11  point  spread,  that  this  difference  is  always, 
substantial  and  for  the  higher  order  differences  quite  noticable.  Thus 
increasing  the  spread  increases  the  power,  but  increasing  the  order  diminishes 
it. 


If  we  turn  our  attention  now  to  fidelity  and  look  at  the  residuals,  we 
see  an  entirely  different  situation.  For  the  same  spread  the  fifth  order 
formula  gives  greater  fidelity  (i.e.  smaller  residuals)  than  the  third;  but 
for  the  same  order  the  11  point  spread  gives  better  fidelity  than  the  2 5 point. 

We  can  combine  these  remarks  as  applied  to  the  standard  method  by  saying 
that  increasing  the  spread  gives  more  smoothing  but  less  fidelity  whereas 
increasing  the  order  gives  more  fidelity  but  less  smoothing*  This  presents 
something  of  a dilemma. 

If  now  we  turn  to  the  results  obtained  by  the  method  developed  in  this 
report,  and  compare  them  with  the  preceding,  we  tend  to  avoid  this  dilemma. 

The  columns  marked  ^Weighted**  give  the  results  of  the  new  method  for  m*3  and 
two  values  of  n.  It  will  be  seen  that  the  change  to  the  new  method  diminishes 
both  the  residuals  and  the  higher  order  differences.  In  fact  the  residuals  are 
diminished  almost  as ’much  by  the  change  to  the  new  method  with  m still  3 as  they 
are  by.  changing  to  m-*>  with  the  standard  method.  The  first  and  second  differences 
are  diminished  little  if  any;  but  the  third  and  higher  differences  have  their 
means  decreased  to  a small  fraction  of  the  old  results,  the  fraction  varying  from 
one-half  down -to  one-fifth.  When  it  is  recalled  that  this  improvement  in  smooth- 
ing power  is  accompanied  by  a substantial  improvement  in  fidelity  also,  it  would 
appear  that  the  new  formulas  should  replace  those  commonly  used  in  all  cases 
where  the  use  of  a smoothing  formula  is  the  appropriate  procedure. 


27 


20.  Acknowledgements  are  due  to  Mr.  Paul  Thomas  and  Mr.  H.  K.  Sterrett, 
both  formerly  of  the  Computing  Laboratory.  Both  have  made  valuable  suggestions. 
Mr.  Sterrett  has  read  the  paper  in  detail  and  supervised  the  preparation  of 
Tables  11  to  18. 


L.  S.  Dederick 


28 


Table  1 


Data  Multipliers 

(Exact  Values) 
m ■ 0 


1 n 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

,, . 

0 

a 

9 

16 

25 

36 

a 9 

6a 

81 

100 

121- 

144 

169 

+1 

3 

8 

15 

24 

35 

48 

63 

80 

99 

120 

143 

168 

+2 

0 

12 

21 

32 

U5 

60 

77 

96 

117 

l4o 

165 

+3 

0 

7. 

16 

27 

ao 

55 

72 

91 

112 

135 

160 

+4 

n 

9 

20 

33 

as 

65 

ea 

105 

128 

153 

+5 

0 

11 

2a 

39 

56 

75 

96 

119 

144 

0 

13 

28 

45 

64 

85 

108 

133 

17 

0 

15 

32 

51 

72, 

95 

120 

+8 

fl 

17 

• 36 

57 

80 

io5 

■ 

19 

40 

63 

88 

l10 

n 

21 

44 

69 

+11 

■ 

23 

48 

l12 

■ 

25 

Divisor 

ID 

35 

84 

165  286  455 

6Q0 

969 

1330  1771 

2300 

2925 

2 9 


Table  2 

Data  Multipliers 
(Exact  Values) 
m = 1 

i n 

1 

2 

3 

1* 

5 

6 . 

7 

8 

9 

10 

11 

12 

0 

3 

12 

100 

75 

u*7 

781* 

1*32 

675 

302$ 

11*52 

2028 

8281 

ii 

2 

10 

90 

70 

mo 

756 

1*20 

660 

2970 

11*30 

2002 

8190 

i2 

0 

5 

63 

56 

120 

675 

385 

616 

2808 

1365 

1925 

7920 

i3 

0 

0 

28 

36 

90 

550 

330 

51*6 

251*8 

1260 

1800 

71*80 

0 

0 

15 

55 

396 

260 

1*55 

2205 

1120 

1632 

6885 

-5 

0 

0 

22 

231* 

182 

350 

1800 

952 

11*28 

6156 

0 

0 

91 

105 

21*0 

1360 

765 

1197 

5320 

i? 

0 

0 

1*0 

136 

918 

570 

950 

1*1*10 

0 

0 

51 

513 

380 

700 

31*65 

-9 

0 

0 

190 

210 

1*62 

2530 

-10 

0 

0 

77 

253 

1656 

in 

0 

0 

92 

900 

tl2 

0 

0 

325 

Divisor 

7 

1*2 

1*62 

1*29 

1001 

6188 

3876 

6783 

3361*9 

17710 

26910 

118755 

Table  3 

Data  Multipliers 

(Exact  Values) 

m - 2 

i n 

2 

3 

1* 

5 

6 

7 

8 

9 

10 

11 

12 

0 

160 

885 

805 

25676 

1*032 

1*0860 

386595 

209935 

8506781* 

580853 

538265 

*1 

81* 

630 

6U8 

22050 

3600 

371*22 

360360 

198198 

8108100 

557700 

519792 

±2 

-21 

126 

288 

13050 

21*75 

28182 

288288 

1651*38 

698197? 

1*91700 

1*66752 

+3 

0 

-126 

-2U 

3300 

1100 

16016 

188552 

1181*82 

5325600 

392700 

385968 

th 

0 

0 

-99 

-21*75 

0 

1*61*1 

85995 

67032 

31*27200 

2751*00 

287793 

*> 

0 

0 

0 

-2571* 

-1*68 

-2730 

501*0 

211*20 

1610781* 

156978 

181*680 

• t6  • 

0 

0 

0 

-325 

-1*732 

-38080 

-9996 

169575 

51*150 

89376 

-7 

0 

0 

0 

-2652 

-1*1616 

-23256 

-701100 

-19950 

12936 

-6 

0 

0 

0 

-2031*9 

-2031*9 

-957600 

-58575 

-37191 

±9 

0 

0 

0 

-901*1* 

-731500 

-63250 

-58696 

-ID 

0 

0 

0 

-30281*1 

-1*1*022 

-55200 

-11 

0 

0 

0 

-17250 

-35880 

^12 

0 

0 

0 

-131*55 

DIVISOR 

286 

211i5 

21*31 

92378 

16796 

19315U 

201*2975 

1225785 

51*367170 

1*032015 

1*032015 

Table  1* 

Data  Multipliers 
(Exact  Values) 
m ■ 3 


n 

i 

2 

3 

1* 

5 

6 

7 

8 

9 

10 

11 

12 

0 

111 

U69 

2881* 

7308 

1*8636 

82761* 

331*323 

76271*77 

12739727 

1856127 

111*89296 

+ 

-1 

56 

321* 

2268 

6160 

1*2768 

71*81*1* 

: 308308 

7135128 

1201*6320 

1769768 

11027016 

-2 

-Hi 

51* 

918 

31*10 

27918 

5l*o51* 

238238 

5783778 

10115820 

1526668 

9711*276 

is 

• 

0 

-60 

-132 

660 

10868 

28028 

11*5236 

3913728 

7360320 

1171368 

7759752 

ia 

0 

0 

-297 

-715 

-1287 

5733 

56056 

1979208 

1*351320 

7671*1*8 

51*68067 

0 

0 

0 

-572 

-5H*8 

-6552 

—6661* 

1*11261* 

1671*1*32 

383721* 

3182652 

16 

0 

0 

0 

0 

-2860 

-8092 

-3281*1* 

-515508 

*-222870 

79002 

122011*2 

-7 

0 

0 

0 

0 

-3672 

-281*21* 

-7671*1*8 

-111*9120 

-111188 

—191268 

ie 

0 

0 

0 

0 

-11305 

-51*91*23 

-121321*5 

-1821*13 

-95631*0 

-9 

0 

0 

0 

0 

-198968 

— ' 769120 

-160908 

-1128380 

.■r 

-10 

0 

0 

0 

0 

-259578 

-93610 

-888030 

in 

0 

0 

0 

0 

-29900 

-1*81*380 

ii2 

0 

0 

0 

0 

-11*8005 

Divisor 

195 

1105 

8398 

25191* 

193151* 

3711*50 

1671525 

1*2010995 

76608285 

1209601*5 

8061*0300 

+ 1 


Table  5 

Data  Multipliers 
(Exact  Values) 


m - 1* 

i n 

3 

h 

5 

6 

7 

8 

9 

10 

11 

0 

571*1* 

51756 

216012 

23981*1* 

1*093581* 

281*50851 

1518803 

9739301 

11*0056381* 

-1 

21*75 

31680 

151*1*1*0 

187200 

3378375 

21*393600 

13381*80 

8760960 

127992150 

-2 

-990 

-660 

31*320 

7251*0 

1706250 

11*1*32880 

87981*0 

6205680 

95830020 

-3 

165 

-701*0 

-3071*5 

-1661*0 

123305 

3758720 

31*1*760 

3035520 

51*01*1130 

ii* 

0 

211*5 

-15015 

-32565 

-56781*0 

-2813160 

-55080 

31*881*0 

1531*8960 

-5 

0 

0 

9009 

-1*992 

-380562 

-3792768 

-209301*  -HI6288 

-10261*617 

16 

0 

0 

0 

881*0 

3091*0 

-11*1*701*0 

-15501*0 

-1279080 

-19205010 

-7 

0 

0 

0 

0 

125970 

620160 

-29070 

-65661*0 

-11*925735 

is 

0 

0 

0 

0 

0 

712215 

1*1895 

19665 

-528261*0 

-9 

0 

0 

0 

0 

0 

30590 

279680  • 

2093575 

-10 

0 

0 

0 

0 

0 

157320 

381*8130 

tn 

0 

0 

0 

0 

0 

18161*25 

tl2 

- 

0 

0 

0 

0 

0 

DIVISOR 

901*1* 

101*006 

520030 

668610 

129261*60 

100180065 

589291*5  1*1250615 

61*261*1160 

12 

llo588o!*61* 
10232 61*000 
7991*25000 
U97988U80 
200016135 
-23836032 
-1361*22660 
-11*351*2080 
-8581*2900 
-16596800 
21*1*51*980 
27820800 
11555775 
51*621*1*9860 


Table  6 

Date  Multiplier* 


Decimal  Approximations 
n ■ 0 


ia  1 

2 

3 

6 

5 

6 

7 

8 

9 

10 

11 

12 

o 0.600000000 

0.257162856 

0.190b 76190 

0.151515152 

0.1?587bl?6 

0.107692308 

0.09bll76b6 

0.083591330 

0.075187970 

0.068322980 

0.062608696 

0.057777778 

♦1  0.300000000 

0.220571629 

0.178571629 

0.11,5b  Sb5b5 

0.122377623 

0.105b9b50b 

O.O926b7059 

0.0825S93b0 

0.07bb36090 

0.067758328 

0.062173913 

O.OS7b35898 

♦2 

0.162057163 

0.162857163 

0.127272727 

0.111888112 

0.098901099 

0. 08823529b 

0.079b6336b 

0.07218 0b5l 

0.06606b37O 

0.060869565 

0.056bl0256 

♦3 

0.003333333 

0.096969697 

0.09bb0559b 

0.007912088 

0.080882353 

0.07b303b06 

0.068b 2 1053 

0.063 2b 1107 

0.058695652 

0.05b700855 

♦6 

0.05b5b5b55 

0.069930070 

0.072527b73 

0.070588235 

0.067079b63 

0.063157895 

0.059288538 

0.05565217b 

0.052307692 

*5 

0.036b6l538 

0.0527b72S3 

0.0573529bl 

0.057791538 

0.056390977 

O.o5b206663 

0.051739130 

0.0b9230769 

0.029571b 29 

O.Obll76b71 

O.Qb6b39628 

0.068120301 

0.067995683 

O.Ob6956522 

0.0b 5670085 

*1 

0.02205882b 

0.033023736 

0.0383b5865 

O.Ob065b997 

O.Obl3Ob3b0 

0.0bl0256bl 

*8 

o.oi75b3860 

0.027067669 

0.032185206 

0.03b782609 

0.035897b36 

*9 

0.01b 285714 

0.022586110 

0.02739130b 

0.030085b7O 

*10 

0.011057708 

0.019130U3S 

0.023589766 

*n 

0.010000000 

0.0l6bl0256 

*12 

01008567009 

Table  7 

Data  Multipliers 

Deolaal  Approximations 

m - 1 


n 


i 1 

2 

3 

li 

5 

6 

7 

8 

9 

10 

n 

12 

0 O.U2&571ii28 

0.285711(286 

0. 21614502 16 

0.m82517l4 

0.il46853lb6 

0.126696832 

0,1111)55108 

0.0995131)90 

0.089896660 

0.081987578 

0.075362320 

0.069731800 

+1  0.2657114286 

0.23B  095238 

0.1914805195 

0.163170163 

0 .13986OII4O 

0.12217191)6 

0.108359131) 

0. 097302080 

0.088261)139 

0.06071)531)1 

0.071)396136 

0.068965517 

+2 

0.11901)7619 

0.136363636 

0.130536131 

0.119880120 

0. 10908 209U 

0.099329206 

0.090615273 

0.0831)1.9731 

0.07707509 9 

0.071531)71)5 

0.066691929 

♦3 

0.060606061 

0.08391606(4 

0.069910090 

O.0688817O7 

0.065139319 

0.0601)95356 

0.075722901) 

0.07111)621)5 

0.066889632 

0.062986822 

♦1) 

0.0314965035 

0.051491)5055 

0.063991)829 

0.0670791)63 

0. 0670791)63 

0.0655291)36 

0.06321)1107 

0.06 061)6600 

O.O57976506 

♦5 

0.021978022 

0.037615126 

0.01)6955621) 

0,051599587 

0.0531)931)17 

0.053751)91)1 

0.053065775 

0.051837817 

*6 

0,011)705882 

0.027089783 

0.035382571) 

0.01)01)1721)9 

0.01)3195931) 

0.01)1)1)81605 

0.01)1)798111) 

♦7 

0.010319917 

0.020050125 

0.02728161)3 

0.032185206 

0.035302661 

0. 03713 5279 

♦8 

0.007518797 

0.01521)5621) 

0.0211)56801) 

0.026012635 

0.029177719 

♦9 

0.00561)6527 

0.0118577  06 

0.017168339 

0.021301)366 

♦10 

0.001)31)7826 

0.0091)01709 

0.0139U)676 

+n 

0.0031)18603 

0.007578628 

♦1? 

0.002736727 

♦ l'  ♦'F  I 


Table  8 

Data  Multipliers 
Decimal  Approximations 
m • 2 


n 

i 


6 


9 io  n 


0 0.559Wi05S8 

1 0.29370629)4 
-0.073)426573 


5 

16 

*-7 

10 

i9 

-10 

in 


0.1il2587)4l2  O.33II39I4I48  0.277914)4966  0.2L0057156  0.2115141050 

0.29370629)4  0.266556972  0.238693195  0.21143367)47  0.1937141782 

0.0587)41259  O.II8I469766  O.U4I267I4OI  0.1)47356513  0.114590143014 

■0.0587)41259  -0.009872)480  0.035722791  0.065)491781  0.082918293 

-0.0I4 07 23982  -0.026792093  0.000000000  O.O2I4O27I46O 
-0.027863777  -0.027863777  -O.OD4I338OO 
-0.01931498)45  -0,02)4)498587 
-0.013729977 


0.189231390 

0.176389823 

0.1141111859 

0.092292857 

O.OI42093026 

0.0021466991 

-0.018639)48)4 

-0.020370293 

-0.00996014714 


0.171265760 
0.161690672 
0.13)496)49141 
0.0966 5B 060 
0.05l4681i957 
0.01714714516 
-0.00015147714 
-0.018972332 
-0.016600791 
-0.007378129 


O.156J46913I4 

0.1)49135958 
0.128 1422631 
0.097956175 
O.0630380I43 
0.029627880 
0.003119070 
-0.012895650 
-0.017613571 
-O.OI3I45I48II 
-0.005570292 


O.D4I4O60228 
0.138317938 
0.12191489  51 
0.097395)471 

0.068303317 

0.038932891 
0.013)430010 
-0.00)49)47  8 98 
-O.OU4527I476 
-O.OI56869I46 
-O.OI0918ID4 
-O.OOU278258 


12 

0.133U97768 

0.128916187 

0.115761)47)4 

0.09572583)4 

0.071376967 

0.0)45803)401 

0.02216658)4 

0.003208321 

-0.00922392)4 

-0.01)4557)486 

-0.013690)425 

-0.008898776 

-0.0033370m 


CO 


Table  9 

Data  Multipliers 
Decimal  Approximations 


1 2 

3 1*  5 6 

0 

1,000000000  0.569230770 

0.1x21*1*31(390  0.31*31*15098  0.290069061*  0.251799081* 

*1 

0.2871791*87 

0.293212670  0.270061*301  0.21*1*502659  0.2211*19178 

-0.071791*872 

0.01*8868778  0.10931171*1  0.13531*9686  0.111*537519 

*3 

-0.051*29861*3  -0.01571802  8 0.026196711*  0.056265985 

3* 

-0.035365563  -0.028379773  -0.006663077 

15 

-0.022703818  -0.026652309 

t6 

~1 

-0.011*806838 

ie 

i9 

*v> 

in 

-12 

7 

8 

9 

10 

11 

12 

0.222813298 

0.200010768 

0.181559066 

0.166296986 

0.1531*1*9082 

0.11*21*75860 

0.2011*911*52 

0.181*1*1*7137 

0.169839539 

0.15721*5656 

0.11*630961*0 

0.13671*321*1 

0.11*5S2l605 

0.11^52  7333 

0.137672959 

0.13201*6031 

0,126212163 

0.1201*61*281* 

0.0751*5561*7 

0.086888321 

0.093159612 

0.096077337 

0.096830925 

0.096226725 

o.oi51*3l»no 

0.03353581*3 

0.01*7111667 

0.056799601 

0.0631*1*6193 

0.067808118 

-0.017638982 

-0.003986779 

0.0097891*37 

0.021857062 

0.031723096 

0.0391*67261* 

-0.021781*897 

-0.01961*9123  -0.012270786  -0.002909216 

0.006531226 

0.015130673 

-0.009885581*  -0.017001(831  -0.018267789  -O.Ol!(9999l(l(  -0.009192095  -0.002371866 
-0.006763285  -0.013078076  -0.015836995  -0.015080381*  -O.OU859331 
-0. 001*7 3609U  -0.01003961*5  -0.013302530  -0.013992755 
-0.003388380  -0.007738893  -0.011012236 
-0.0021*71882  -0.006006671* 
-0.001835373 


Table  10 


Data  Multipliers 
Dec  Inal  Approximations 


0 0.635117206  0.1*97625130  0.1*15303728  0.350720330  0.316682520  0.283997132  0.2577321*21*  0.23610071*8  0.217938708  0.2021*51372 

1 0.273662096  0.301*597812  0.296982B65  0.27998381*7  0.2613531*56  0.21*31*97516  0.2271J2613  0.21230371*3  0.199165813  0.187326938 

2 -0.1091*61*839  -0.00631*5788  0.065996193  0.1081*9371*1  0.131996695  0.11*1*069381  0.11*9303956  0.1501*381*81*  0.11*9119020  0.11*631*9170 


- 3 0.01821*1*11*0  -0.0676881*03  -0.059121589  -0.021*8871*53  0.009538961  0.03751961*0  0.058503855 

4- 

- 1*  0.020623810  -0.02B873331*  -0.01*8705523  -0.01*3928500  -0.028081036  -0.00931*6770 


0.073587267  0.081*092233  0.09U65776 

0.0081*56601  0.023081*181*  0.036616562 


0.017321*001  -0.0071*66236  -0.0291*1*051*3  -O.O378595O0  -0.035517725  -0.027061121*  -0.01597251*8  -0.001*363616 
0.013221 1*59  0.00239351*0  -0.011*1*1*1*391  -0.0263091*26  -0.031007538  -0.029881*500  -0.021*971*629 
0.00971*5127  0.0061901*53  -0.001*933017  -0.015918308  -0.023225613  -0.026277968 

0.00710931*9  0.00710931*9  0.0001*76720  -0.008220202  -0.015715092 

0.005190953  0.006780020  0.003257767  -0.00303931*1* 

0.003813761  0.005987992  0.001*2*76925 

0.002826500  0.005093099 

0.0021151*93 


table  11 

OBSERVED  VALUES 


ITEM 

NUMBER 

V-Angle 

(Degrees) 

DIFFERENCES 

a' 

A" 

1 

14.  1 

2 

13.  0 

-1.  1 

3 

12.6 

-0.  4 

0.7 

4 

12.0 

-0.6 

-0.  2 

-0.9 

5 

10.  8 

-1.2 

-0.  6 

-0.4 

0.5 

6 

9.7 

-1.  1 

0.  1 

0.  7 

1.  1 

0.6 

7 

8.0 

-1.  7 

-0.6 

-0.  7 

-1.4 

-2.5 

8 

7.  7 

-0.3 

1.4 

2.0 

2.7 

4. 1 

9 

7.6 

-0.1 

0.2 

-1.  2 

! -3.  2 

-5.9 

10 

7.  1 

-0.5 

-0.4 

-0.6 

0.6 

3.  8 

11 

7.  1 

0.0 

0.5 

0.  9 

1.  5 

0.9 

12 

7.6 

0.  5 

0.5 

0.0 

-0.9 

— 2.  4 

13 

7.  5 

"*  •»  •*  P*  wm  — m 
-0.1 

“ ~ :<5\  " 

--zr.l-- 

I « R R R R R f»  »• 

-0. 2 

14 

8.  3 

0.  8 

0.  9 

1.5 

2.6 

3.  7 

15 

9.0 

0.  7 

-0.  1 

--I.0 

-2.5 

-5.  1 

16 

10.  7 

1.  7 

1.0 

1. 1 

2.  1 

4.  6 

17 

11.  1 

0.4 

-1.3 

-2.  3 

-3.4 

-5.5 

18 

11.  8 

0.7 

0.  3 

1.6 

3.9 

7.3 

19 

1376T: 

1.8 

1. 1 

0.  8 

-0.  8 

-4.  7 

20 

13.5 

-0.1 

-1.9 

-3.0 

-3.  8 

—3 . 0 

21 

1.4.  8 

1.3 

1.4 

3.  3 

6.3 

10.  1 

22 

14.4 

-0.4 

-1.  7 

-3.  1 

-6.  4 

-12.  7 

23 

15.  3 

0.  9 

1.3 

3.0 

6.  1 

12.  5 

24 

15.6 

0.  3 

-0,6 

-1.9 

-4.9 

-11.0 

25 

15.  2 

-0.  4 

-0.  7 

-0.  1 

1.  8 

6.7 

26 

14.  2 

-1.0 

-0.6 

0.  1 

0.2 

-1.6 

27 

13.9 

-0.  3 

0.7 

1.3 

1.2 

1.0 

28 

14.  1 

0.  2 

0.  5 

-0.  2 

-1.5 

-2.  7 

29 

13.  2 

-0.  9 

-1. 1 

-1.6 

-1.4 

0.  1 

30 

12:  0 

-1.  2 

'SO.  3 

0.8 

2.4 

3.8 

31 

10.  2 

-1.  8 

-0.  6 

-0.  3 

-1.  1 

-3.  5 

32 

9.6 

-0.6 

1.2 

1.8 

2.1 

3.  2 

33 

8.2 

-1.4 

-0.  8 

-2.0 

-3.  8 

-5.9 

34 

6.  6 

-1.6 

-0.2 

0.6 

2.6 

6.  4 

35 

5.1 

-1.5 

0.1 

0.3 

-0.  3 

-2.9 

36 

3.9 

-1.2 

0.3 

0.2 

-0.  1 

0.2 

37 

3.5 

-0.  4 

0.8 

0.  5 

0.  3 

0.4 

38 

3.  2 

-0.3 

0. 1 

-0.  7 

-1.  2 

-1.  5 

39 

3.  2 

0.0 

0.  3 

0.  2 

0.9 

2.  1 

40 

2.  9 

-0.  3 

-0.  3 

-0.6 

-0.  8 

-1.7 

41 

2.  1 

-0.  8 

-0.5 

-0.  2 

0.4 

1.2 

42 

2.  2 

0.  1 

0.  9 

1.4 

1.6 

1.2 

39 


TABLE  11 

OBSERVED  VALUES 


ITEM 

NUMBER 

V-Angle 

(degrees) 

Differences 

A' 

A" 

A" 

Av 

43 

2.6 

0.4 

0.  3 

-0.6 

-2.0 

-3.  6 

44 

3.  3 

0.  7 

0.  3 

0.0 

0.6 

2.6 

45 

4.  2 

0.9 

0.  2 

-0. 1 

-0.1 

-0.7 

46 

5.4 

1.2 

0.3 

0.  1 

0.  2 

0.3 

47 

7.6 

2.2 

1.0 

0.7 

0,6 

0.4 

48 

8.  5 

0.9 

-1.3 

-2.3 

-3.0 

-3.  6 

49 

10.  5 

2.0 

1.  1 

2.4 

4.  7 

7.7 

50 

10.  5 

0.0 

-2.0 

-3.  1 

-5.  5 

-10.2 

51 

11.5 

1.0 

1.0 

3.0 

6. 1 

11.6 

52 

12.  7 

1.  2 

0.  2 

-0.8 

-3.8 

-9.9 

53 

13.  2 

0.5 

-0.7 

-0.9 

-0.1 

3.7 

54 

13.9 

0.  7 

0.2 

0.  9 

1.8 

1.9 

55 

13.  7 

-0.  2 

-0.9 

~1  . 1 

- 2.  0 

-3.  8 

56 

13.  2 

-0.5 

-0.3 

0.6 

1.  7 

3.  7 

57 

12.7 

-0.5 

0.0 

0.3 

-0.  3 

-2.0 

58 

11.  1 

—1.6 

-1.  1 

-1.  1 

-1.4 

-1. 1 

59 

10.4 

-0.  7 

-0.9 

2.  0 

3.  1 

4.  5 

60 

8.  9 

-1.  5 

-0.  8 

-1.  7 

-3.7 

-6.  8 

61 

7.  5 

-1.4 

0. 1 

0.  9 

2.6  „ 

6.3 

62 

6.0 

-1.  5 

-0.  1 

-0.  2 

-1. 1 

-3.  7 

63 

3.  9 

-2.  1 

-0. 6 

-0.5 

-0.3 

0.8 

64 

3.  1 

-0.  8 

1.3 

1.  9 

2.4 

2.7 

65 

2.0 

-1.  1 

-0.  3 

-1.6 

-3.  5 

-5.9 

66 

1.1 

-0.  9 

' 0.  2 

0.5 

2.1 

5.6 

67 

1.  3 

0.  2 

1.  1 

0.9 

0.4 

-1.  7 

68 

-1.  1 

-2.4 

-2.  6 

-3. 7 . 

-4.  6 

-5.0 

69 

-2.0 

-0.  9 

1.5 

4.  1 

7,  8 

12.4 

70 

-1.  1 

0.  9 

1.8. 

0.  3 

-3.  8 

-11.6 

71 

-1.  1 

0.0 

-0.  9 

-2.  7 

-3.  0 

0.8 

72 

-0.4 

0.  7 

0.7 

1.6 

4.  3 

7.  3 

73 

2.1 

2.5 

1.8 

1. 1 

-0.  5 

-4.8 

TABLE  12 
ADJUSTED  VALUES 

(STANDARD  METHOD  - 3rd.  DEGREE  - 11  VALUE  SPREAD) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Value 

s 

mm 

L;; 

A"' 

A'" 

1 

14.  1 

2. 

13.  0 

3 

12.  6 

4 

12.  0 

5 

10.  8 

6 

9.  7 

9.  33 

0.  37 

• 

7 

8.0 

8.67 

-0.67 

-0.  66 

8 

7.  7 

7.  91 

-0.  21 

-0.  76 

-0.  10 

9 

7.6 

7.36 

0.  24 

-0.55 

0.  21 

0.31 

10 

7.  1 

7.12 

-0.  02 

-0.  24 

0.  31 

0.  10 

-0.  21 

11 

7.  1 

7.  07 

0.03 

-0.05 

0.  19 

-0.  12 

-0.22 

-0.01 

12 

7.6 

7.40 

0.  20  ' j 

0.  33 

0.38 

0.  19 

0.31 

0.  53 

If’" 

9*  w*  **  "m  ^ 

7.  5 

"”03" 

" =(7."45  " 

■=(7.^7" 

14 

8.  3 

8.  38 

-0.  08 

0.  54 

0.  10 

-0.01 

0.  26 

0.  72 

15 

9.0 

9.  27 

-0.  27 

0.  89 

0.  35 

0.25 

0.  26 

0.00 

16 

10.  7 

10.16 

0.  54 

0.  89 

0.00 

-0.35 

-0.60 

-0.  86 

17 

11.  1 

11.  20 

-0.  10 

1. 04 

0.  15 

0. 15 

0.50 

1.  10 

18 

11.  8 

12.  18 

-0.  38 

0.  98 

-0.06 

-0.  21 

-0.  36 

-0.  86 

19 

13.  6 

13.02 

0.  58 

0.  84 

-0.  14 

-0.08 

0.  13 

0.49 

20 

13.5 

13.  80 

-0.  30 

0.  78 

-0.  06 

o;  08 

0. 16 

0.03 

21 

14.  8 

14.  45 

0.35 

0.65 

-0.  13 

-0.  07 

-0.  15 

-0.31 

22 

14.4 

14.  96 

-0.  56 

0.  51 

-0. 14 

-0.  01 

0.06 

0.  21 

23 

15.  3 

15.  12 

0.  18 

0.  16 

-0.  35 

-0.  21 

-0.  20 

-0.  26 

24 

15.  6 

15.  08 

0.  52 

-0.  04 

-0.  20 

0.  15 

0.  36 

0.  56 

25 

15.  2 

15.  05 

0.  15 

-0.03 

0.  01 

0.  21 

0.06 

-0.  30 

26 

14.  2 

14.  80 

-0.60 

-0.  25 

-0.  22 

-0.  23 

-0.44 

-0.  50 

27 

13.9 

i4.  34 

-0.44 

-0.46 

-0.  21 

0.01 

0.24 

0.  68 

28 

14.  1 

13.61 

0.49 

-0.  73 

-0.  27 

-0.06 

-0.07 

-0.  31 

29 

13.  2 

12.  79 

0.41 

-0.  82 

-0.09 

0.  18 

0.  24 

0.  31 

30 

12.0 

11.  88 

0.  12 

-0.91 

-0.  09 

0.  00 

-0.  18 

-0.42 

31 

10.  2 

10.  79 

-0.  59 

-1.09 

-0.  18 

-0.  09 

-0.  09 

0.  09 

32 

9.  6 

9.  38 

0.  22 

-1.41 

-0.  32 

-0. 14 

-0.05 

0.  04 

33 

8.2 

7.  86 

- 0. 34 

-1.52 

-0.  11 

0.  21 

0.35 

0.40 

34 

6.6 

6.49 

0.  11 

-1. 37 

0.  15 

0.  26 

0.05 

-0.  30 

35 

5.  1 

5.  34 

-0.  24 

-1.15 

a 22 

0.07 

-0. 19 

-0.  24 

36 

3.9 

4.47 

-0.  57 

-0.  87 

0.  28 

0.06 

-0.01 

0.  18 

37 

3.  5 

3.65 

-0.  15 

-0.  82 

0.  05 

-0.  23 

-0.  29 

-0.  28 

38 

3.  2 

3.09 

0.  11 

-0.56 

0.  26 

0.  21 

0.44 

0.73 

39 

3.  2 

2.  72 

0.48 

-0.  37 

0.  19 

-0.07 

-0.  28 

-0.  72 

40 

2.  9 

2.  50 

0.  40 

-0.  22 

0.15 

-0.  04 

0.03 

0.  31 

41 

2.1 

2.41 

-0.31 

-0.09 

0.  13 

-0.62 

0.  02 

-0.01 

42 

2.  2 

2.  38 

-0.  18 

-0.03 

0.  06 

-0.  07 

-0.05 

-0.07 

43 

2.6 

2.  72 

-0.  12 

0.  34 

0.  37 

0.  31 

0.  38 

0.43 

44 

3.  3 

3.  32 

-0.02 

0.  60 

0.  26 

-0.  11 

-0.42 

-0.  80 

45 

4.  2 

4.45 

-0.  25 

1 

1.  13 

0.  53 

0.  27 

0.  38 

0.80 

iil 


TABLE  12 
ADJUSTED  VALUES 

(STANDARD  METHOD  - 3rd.  DEGREE  - 11  VALUE  SPREAD) 


ITEM 

Original  Adjusted 
Value  Value 

(Degrees)  (Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

* 

A 

A" 

A,f/ 

A" 

A' 

46 

5.  4 

5.  80 

"0.  40 

1. 35 

0.  22 

-0.31 

-0.58 

-0.  96 

47 

7.6 

7.  12 

0.  48 

1.  32 

-0.  03 

-0.  25 

0.  06 

:o.64 

48 

8.  5 

8.48 

0.  02 

1.  36 

0.  04 

0.07 

0.  32 

0.26 

49 

10.  5 

9.  75 

0.  75 

1.27 

-0.  09 

-0.  13 

-0.  20 

-0.52 

50 

10.  5 

10.93 

-0.43 

1.  18 

-0.  09 

0.00 

0. 13 

0.33 

51 

11.5 

11.  92 

-6.  42 

0.  99 

-0.  19 

-0.  10 

-0.  10 

-0.  23 

52 

12.  7 

12.62 

0.  08 

0.  70 

-0.  29 

-0.  10 

0.00 

0. 10 

53 

13.  2 

* 13. 27 

-0.  07 

0.65 

-0.05 

0.  24 

0.  34 

0.  34 

54 

13.9 

13.  50 

0.40 

0.  23 

-0.42 

-0.  37 

-0.61 

-0.95 

55 

13.  7 

13.  59 

0.  11 

0.  09 

-0.  14 

0.  28 

0.65 

1. 26 

56 

13.  2 

13.  21 

-0.  01 

-0.  38 

-0.47 

-0.  33 

-0.61 

-1.  26 

57 

12.  7 

12.  47 

0.  23 

-0.  74 

-0.  36 

0.  11 

0.44 

1.05 

58 

11.  1 

11.54 

-0.44 

-0.93 

-0.  19 

0.  17 

0.  06 

-0.38 

59 

10.  4 

10.  23 

0.  17 

-1.  31 

-0.  38 

-0.  19 

-0.  36 

-0.  42 

60 

8.  9 

8.83 

0.  07 

-1.40 

-0.  09 

0.  29 

0.48 

0.  84 

61. 

m mm  <m  Z*  *• 

2.J4 CL.J6 

„ = L..49  _ j 

sa.£9. 

-=Q,J2~ 

62 

6.0 

5.  76 

0.  24 

-1.58 

-0.  09 

0.00 

0.  00 

0.  20 

63 

3.  9 

4.55 

-0.65 

-1.21 

0.  37 

0.46 

0.46 

0.46 

64 

3.  1 

3.30 

-0.  20 

-1.  25 

-0.04 

-0.41 

-0.  87 

-1. 33 

65 

2.  0 

2.  05 

-0.  05 

-1.  25 

0.00 

0.  04 

0.45 

1.  32 

66 

1. 1 

0.96 

0. 14 

-1. 09 

0.  16 

0.  16 

0.  12 

-0.  33 

67 

1.  3 

0.06 

1.  24 

-0.  90 

0.  19 

0.03 

-0.  13 

-0.  25 

68 

-1. 1 

-0.72 

-0.  38 

-0.  78 

0.  12 

-0.07 

-0.  10 

0.  03 

69 

-2.  0 

70 

-1.  1 

71 

-1.  1 

72 

-0.  4 

• 

73 

2.  1 

- 

4z 


TABLE  13 
ADJUSTED  VALUES 

(STANDARD  METHOD  - 5th  DEGREE  - 11  VALUE  SPREAD) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value  Residual 

(Degrees)  (Degrees) 

Difference  for  Adjusted  Values 

A ' 

A" 

ESSH 

hJv 

1 

14.1 

2 

13.0 

3 

12.6 

4 

n.e 

5 

10.  8 

6 

9.7 

9.56 

0.  14 

7 

8.  0 

8.46 

-0.  46 

-1.  10 

8 

7.  7 

7.65 

0.05 

-0.  81 

‘ 0.  29 

9 

7.6 

7.31 

0.  29 

-0.  34 

0.47 

0. 18 

10 

7.  1 

7.  20 

«0.  10 

-0.  11 

0.  23 

-0.  24 

-0.42 

11 

7.  1 

7.  29 

-0.  19 

0.09 

0.  20 

-0.  03 

0f  21 

0.63 

12 

7.6 

7.  26 

0.  34 

-0.  03 

-0.  12 

-0.  32 

-0.  29 

-0.  50 

\S~~ 

» M « ^ ^ W 

7.  5 

"OS" 

^ **•.  n X M 

a.  4i 

05** 

•""f .14" 

14 

8.3 

8.42 

-0.  12 

0.  78 

0.40 

-0.01 

-0.54 

-1.  39 

15 

9.0 

8.  92 

0.  08 

0.  50 

-0.  28 

-0.68 

-0.67 

-0.  13 

16 

10.  7 

10.21 

0.49 

1.29 

0.  79 

1.07 

1.  75 

2.42 

17 

11.  1 

11. 23 

-0.  13 

1. 02 

-0.  27 

-1.06 

-2.1 3 

-3.  88 

18 

11.8 

12.  25 

-0.45 

1.02 

0.  00 

0.  27 

1.  33 

3.46 

19 

13.6 

13.  10 

0.  50 

0.85 

-0.  17 

-0.  17 

-0v44 

-1.  77 

20 

13.  5 

13.  75 

-0.  25 

0.65 

-0.  20 

-0.03 

-Or  14 

0.  58 

21 

14.  8 

14.43 

0.  37 

0.68 

0.  03 

0.23 

0.  26 

0.  12 

22 

14.  4 

14.94 

-0.  54 

0.  51 

-0.  17 

-0.  20 

-0.43 

-0.  69 

23 

15.3 

15.24 

0.  06 

0.  30 

-0.  21 

-0.04 

0.  16 

0.  59 

24 

15.  6 

15.  29 

0.  31 

0.  05 

-0.  25 

-0.  04 

0.00 

-0.  16 

25 

15.  2 

14.95 

0.  27 

-0.  34 

-0.  39 

-0.  14 

-0. 10 

—0.  10 

26 

14.  2 

14.64 

-0.44 

-0.31 

*0.03 

0.42 

0.56 

0.66 

27 

13.  9 

14.  21 

-0.31 

-0.  43 

-0.  12 

-0.  15 

-0.  57 

-1.13 

28 

14.  1 

13.  70 

0.40 

-0.  51 

-0.  08 

0.04 

: 0.  19 

0.  76 

29 

13.  2 

12.  99 

0.  21 

-0.  71 

-0.  20 

-0.  12 

-0.  16 

-0.  35 

30 

12.  0 

12.01 

-0.01 

-0.  98 

-0.  27 

-0.  07 

-0.05 

0.  21 

31 

10.  2 

10.  72 

-0.  52 

-1.  29 

-0.  31 

-0.  04 

0.03 

-0.  02 

32 

9.6 

9.36 

0.  24 

- 1 . 36 

-0.07 

0.  24 

0.  28 

0.  25 

33 

8.2 

8.  01 

. 0.  19 

-1.  35 

0.  01 

0.08 

-0.  16 

-0.44 

34 

6.6 

6.58 

0.02 

-1.43 

-0.  08 

-0.  09 

-0.  17 

-0.  01 

35 

5.  1 

5.  19 

-0.  09 

-1.39 

0.04 

0.  12 

0.  21 

0.  38 

36 

3.9 

4.02 

-0.  12 

-1.  17 

0.  22 

0.  18 

0.06 

-0.  15 

37 

3.5 

3.  51 

-0.01 

-0.  51 

0.66 

...0.44 

0.26 

0.  20 

38 

3.2 

3.  25 

-0.  05 

-0.  26 

0.  25 

-0.41 

-0.85 

-1.  11 

39 

3.  2 

3.  02 

0.  18 

-0.  23 

0.  03 

-0.  22 

0.  19 

1. 04 

40 

2.9 

2.  70 

0.  20 

-0.  32 

-0.  09 

-0.  12 

0.  10 

-0.  09 

41 

2.  1 

2.  37 

-0.  27 

-0.  33 

-0.  01 

0.  08 

0.  20 

0.  10 

42 

2.  2 

2.31 

-0.  11 

-0.  06 

0.  27 

0.  28 

0.  20 

0.  00 

43 

2.  6 

2.  45 

0.  15 

0.  14 

0.  20 

-0.07 

-0.  35 

-0.  55 

44 

3.  3 

3.  22 

0.  08 

0.  77 

0.63 

0.43 

0.  50 

0.  85 

1*3 


TABLE  13 
ADJUSTED  VALUES 

(STANDARD  METHOD  - 5th  DEGREE  - 11  VALUE  SPREAD) 


ITEM 

Original 

Values 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

Differences  for  Adjusted  V. 

ilues 

(Degrees) 

mm 

wm 

A'" 

A" 

45 

4.  2 

4.  25 

-0.  05 

1.  03 

0.  26 

-0.  37 

-0.  80 

-1.  30 

46 

5.  4 

5.  68 

-0.  28 

1.43 

0.40 

0.  14 

0.51 

1.  31 

47 

7.  6 

7.  30 

0.  30 

1.62 

0.  19 

-0.  21 

-0.35 

-0.  86 

43 

8.  5 

8.  74 

-0.  24 

1.44 

-0.  18 

-0.  37 

-0.  16 

0.  19 

49 

10.  5 

9.96 

0.  54 

1.  22 

-0.  22 

-0.04 

- 0.  33 

0.49 

50 

10.  5 

10.  86 

-0.  36 

0.90 

-0.  32 

-0.  10 

-0.06 

-0.  39 

51 

11.5 

11.66 

-0.  16 

0.  80 

-0.  10 

"0.  22 

0.  32 

0.  38 

52 

12.  7 

12.  57 

0.  13 

0.  91 

0.  11 

0.  21 

-0.01 

-0.  33 

53 

13.  2 

13.  20 

0.  00 

0.63 

-0.  28 

-0.39 

-0.60 

-0.  59 

54 

13.9 

13.  83 

0.07 

0.  63 

0.  00 

0.  28 

0.67 

1.  27 

55 

13.  7 

13.  73 

-0.03 

-0.  10 

-0.  73 

-0.73 

-1.01 

-1.68 

56 

13.2 

13.  26 

-0.06 

-0.47 

-0.  37 

0.  36 

1.09 

2.  10 

57 

12.7 

12.48 

0.  22 

-0.  78 

-0.  31 

0.06 

-0.30 

-1.39 

58 

11.  1 

11.39 

-0.  29 

-1.09 

-0.31 

0.00 

-0.  06 

0.  24 

59 

10.4 

10.  31 

0.  09 

-1.08 

0.01 

0.  32 

0.32 

0.  38 

60 

8.  9 

8.  93 

-0.  03 

-1.  38 

-0.  30 

-0.  31 

-0.63 

-0.  95 

61 

7.5 

• M M — « n f 

7.  39 

0.  11 

-1. 54 

-0.  16 

0.  14 

M ^ « wm  mm  m 

0.45 

1.08 

62 

6.0 

5.89 

0.  11 

-1. 50 

0.04 

0.  20 

0.  06 

-0.39 

63 

3.9 

4.  13 

-0.  23 

-1 . 76 

—0.  26 

-0.  30 

-0.  50 

-0.  56 

64 

3.  1 

3.  01 

0.09 

-1.  12 

0.  64 

0.  90 

1.  20 

1.  70 

65 

2.0 

2.  20 

-0.  20 

-0.  81 

0.31 

-0.  33 

-1.  23 

-2.  43 

66 

1.  1 

1.28 

-0.  18 

-0.  92 

Boll 

-0.42 

-o;o9 

1.  14 

67 

1.3 

0.  33 

0.97 

-0.  95 

0.  08 

0.50 

0.  59 

68 

69 

70 

71 

72 

73 

-1.  1 
••2.  0 
-I.  1 
-1.  1 
-0.4 
2.  1 

-0.  79 

-0.  31 

-1.  12 

-0.  17 

0.  14 

-0.  22 

-0.  72 

• TABLE  14 

(WEIGHTED  METHOD  * 3rd  DEGREE  - 11  VALUE  SPREAD 


ITEM 

Original 

Value 

(Degrees^ 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees) 

Difference  for  Adjusted  Values 

A' 

A" 

A'" 

A" 

A' 

1 

14.1 

2 

13.  0 

3 

12.6 

4 

12.0 

5 

10.8 

6 

9.7 

9.55 

0.  15 

7 

8.0 

8.54 

-0.  54 

-1.01 

8 

7.  7 

7.  78 

-0.  08 

—0.  76 

0.  25 

9 

7.6 

7.  34 

0.26 

-0.  44 

0.  32 

0.  07 

10 

7.  1 

7.  17 

-0.  97 

-0.  17 

0.27 

-0.  05 

-0. 12 

11 

7.  1 

7. 17 

-0.  07 

0.00 

0.  17 

-0.  10 

-0.05 

0.  07 

12 

7.6 

7.  34 

0.  26 

0.  17 

0.  17 

0.00 

0.  10 

0.  15 

IS"" 

••  rn  jm  m m M M 

7.  5 

""f/W""" 

' "OS  " 

"“"OS'* 

""OS"' 

"-03 

14 

8.  3 

8.  38 

-0.  08 

0.64 

0.24 

0.01 

-0.05 

-0.  1 1 

15 

9.0 

9.  23 

-0,  23 

0.  85 

0.  21 

-0.03 

-0.04 

0.01 

16 

10.7 

10-20 

0.  50 

0.97 

0.  12 

-0.09 

-0.06 

-0.02 

17 

11. 1 

11.22 

-0.  12 

1.02 

0.  05 

-0.07 

0.02 

0.  08 

18 

11.8 

12.20 

-0.40 

0.98 

-0.04 

-0.  09 

-0.02 

-0.04 

19 

13.6 

13.06 

9.  54 

0.  86 

—0.  12 

-0.  08 

0.01 

0.03 

20 

13.  5 

13.80 

-0.  30 

0.  74 

-0.  12 

0.00 

0.08 

21 

14.8 

14.43 

0.  37 

0.63 

-0.  11 

0.01 

0.01 

22 

14.4 

14.92 

-0.  52 

0.49 

-0.  14 

-0.03 

-0.  04 

H 

23 

15.3 

15*19 

0.  11 

0.  27 

-0.  22 

-0.08 

-0.  05 

-0.01 

24 

15.  6 

15.  21 

0.39 

0.  02 

-0.25 

-0.03 

'0.05 

25 

15.  2 

15.02 

:0.  18 

-0. 19 

-0.  21 

0.04 

0.07 

26 

14.2 

14.68 

-0.  48 

-0.  34 

-0.15 

‘ 0.  06 

0.02 

mate 

27 

13.  9 

14.  25 

-0.35 

-0.43 

-0.09 

0.06 

0.00 

■eke 

28 

14.  1 

13.68 

0.42 

-0.  57 

-0.  14 

-0.05 

-0. 1 1 

-0.  11 

29 

13.  2 

12.93 

0.  27 

-0.  75 

-0.  18 

-0.04 

0. 12 

30 

12.0 

11.94 

0.  06 

-0.  99 

-0.  24 

-0.  06 

-0.02 

31 

10.  2 

10.  73 

-0.  53 

-1.21 

-0.  22 

0.02 

0.08 

0.  10 

32 

9.6 

9.  37 

0.  23 

-1.36 

-0.  15 

0.07 

Kxa 

BSS 

33 

8.  2 

7.  96 

0.  24 

-1.41 

-0.05 

0.  10 

EMM 

34 

6.6 

6.  55 

0.05 

-1.41 

0.00 

0.05 

-0.  08 

35 

5.  1 

5.  25 

-0.  15 

-1.30 

0.11 

0.  11 

0.  11 

36 

3.  9 

4.  23 

-0.  33 

-1.02 

0.  28 

0.  17 

mMm, 

HKJl.I.j 

37 

3.5 

3.56 

-0.  06 

-0.67 

0.35 

0.07 

-0. 10 

-0.  16 

38 

3.2 

3.  18 

0.  02 

—0.  38 

0.29 

-0.  06 

-0.  13 

-0.  03 

39 

3.2 

2.  89 

0.31 

-0.  29 

0.09 

-0.  20 

-0.14 

-0.  01 

40 

2.9 

2.61 

0.  29 

-0.28 

0.  01 

-0.08 

0.  12 

0.  26 

41 

2. 1 

2.38 

-0.  28 

-0.  23 

0.  05 

0.04 

0.  12 

0.00 

42 

2.  2 

2.32 

-0.  12 

-0.  06 

0.  17 

0.  12 

0.08 

-0.  04 

43 

2.6 

2.60 

0.00 

0.  28 

0.34 

0.  1? 

0.05 

-0.  03 

44 

3.3 

3.  27 

0.03 

0.  67 

0.  39 

0.05 

-0. 12 

-0.  17 

45 

4.2 

4.  34 

-0. 14 

1.07 

0.40 

0.01 

-0.04 

0.  08 

46 

5.4 

5.  72 

-0.  32 

1.38 

0.  31 

-0.  09 

-0.  10 

-0.06 

TABLE  14 

WEIGHTED  METHOD  - 3rd  DEGREE  - 11  VALUE  SPREAD 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

mm 

A" 

A'" 

A** 

47 

7.6 

7.  22 

0-  38 

1. 50 

0.12 

-0. 19 

-0.  10 

0.00 

48 

8,5 

8.64 

-0.  14 

1.42 

-0.  08 

-0.  20 

-0.01 

0.09 

49 

10.5 

9.  87 

0.  63 

1.  23 

-0.  19 

-0.  11 

0.09 

0.  10 

50 

10.5 

10.  88 

-0.  38 

1.01 

-0.  22 

-0.03 

0.08 

-0.  01 

51 

11.5 

11.  78 

-0.  28 

0.90 

-0.  11 

0.  11 

0.14 

0.06 

52 

12.7 

12.  58 

0.  12 

0.  80 

-0.  10 

0.01 

-0. 10 

-0.24 

53 

13.2 

13.  26 

-0.06 

0.68 

-0.  12 

-0.  02 

-0.03 

0.07 

54 

13.9 

13.66 

0.  24 

0.40 

-0.28 

-0. 16 

-0.  14 

-0.  11 

55 

13.7 

13.67 

0.03 

0.01 

-0.  39 

-0.  11 

0.19 

56 

13.2 

13.24 

-0.04 

-0.43 

-0.44 

-0.05 

0.06 

0.01 

57 

12.7 

12.47 

0.  23 

-0.  77 

-0.  34 

0.  10 

0. 15 

0.09 

58 

11. 1 

11.46 

-0.  36 

-1.01 

-0.  24 

0.  10 

■ 

-0.  15 

59 

10.4 

10.  26 

0.  14 

-1.  20 

-0.  19 

0.  05 

-0.05 

60 

8.9 

8.  89 

0.  01 

-1.37 

-0.  17 

0.02 

riS’W'Tfl 

0.02 

61 

7.5 

7.38 

0.  12 

-1. 51 

-0.  14 

0.03 

0.01 

0.04 

"MI""" 

w m mm  m 

3.  81 

’"<5*.19 

"or 

~"0§~ 

""05" 

”"02"  ' 

63 

3.9 

4.  34 

-0.44 

-1.47 

0.  10 

0.  16 

0.08 

JO.  03 

64 

3.  1 

3.  12 

-0.02 

-1.22 

0.25 

0.  15 

-0.01 

-0.09 

65 

2.0 

2.  11 

-0.  11 

-1, 01 

0.  21 

-0.  04 

-0. 19 

-0. 18 

66 

1.1 

1.  16 

-0.06 

-0.  95 

0.06 

-0.  15 

-0.  11 

0.08 

67 

1.3 

0.22 

1.08 

-0.94 

0.01 

-0.05 

0. 10 

0.  21 

68 

-1. 1 

-0.68 

-0.42 

-0.  90 

0.04 

0.03 

0.08 

-0.02 

k6 


TABLE  15 

(STANDARD  METHOD  - 3rd  DEGREE  - 25  VALUE  SPREAD) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees] 

Difference  for  Adjusted  Va'] 

ues 

m 

A'" 

A'" 

1 

14.  1 

[HI 

2 

I3.p 

3 

12.6 

i 

4 

12.0 

5 

10.  8 

6 

9.7 

7 

8.  0 

8 

7.7 

1 

9 

7.6 

10 

7.  1 

11 

7.1 

12 

#•  tm  +•  • 

7.6 

13 

7.  5 

8.49 

-0.  99 

14 

8.  3 

9.00 

-0.  70 

0.  51 

15 

9.0 

9.  60 

-0.  60 

0.  60 

0.09 

16 

10.  7 

10.27 

0.  43 

0.  67 

0,  07 

-0.  02 

17 

11. 1 

11.  04 

0.  06 

0.  77 

0. 10 

0.03 

0.  05 

18 

11.  8 

11. 85 

-0.  05 

0.  81 

0.04 

-0.06 

-0 . 09 

-0.  14 

19 

13.  6 

12.66 

0.  94 

0.  81 

0.  00 

-0.  04 

0.  02 

0.  11 

20 

13.  5 

13.  32 

0.  18 

0.66 

-0.  15 

-0.  15 

-0.  11 

-0.  13 

21 

14.  8 

13.  90 

6.90 

0.  58 

-0.08 

0.07 

0.  22 

0.33 

22 

14.4 

14.37 

0.  03 

0.  47 

-0.  11 

-0.  03 

-0.  10 

-0.  32 

23 

15.  3 

14.68 

0.  62 

0.  31 

-0. 16 

-0.  05 

-0.  02 

0.  08 

24 

15.6 

14.  80 

0.  80 

0.  12 

-0.  19 

-0.  03 

0.  02 

0.  04 

25 

15.  2 

14.  70 

0.  50 

-0.  10 

-0.  22 

-0.  03 

0.00 

-0.  02 

26 

14.  2 

14.  34 

-0. 14 

-0.36 

—0.  26 

-0.  04 

-0.01 

-0.  01 

27 

13.  9 

13.  77 

0.  13 

-0.  57 

-0.  21 

0.05 

0.  09 

0.  10 

28 

14.  1 

13.04 

1.06 

-0.  73 

-0.  16 

0.  05 

0.00 

-0.09 

29 

13.  2 

12.25 

0.95 

-0.  79 

-0.  06 

0.  10 

0.  05 

0.  05 

30 

12.  0 

11.  31 

0.69 

-0.  94 

-0.  15 

-0.09 

-0.  19 

-0.  24 

31 

10.  2 

10.  26 

-0.  06 

-1. 05 

-0.  11 

0.04 

0. 13 

0.  32 

32 

9.6 

9.  20 

0.40 

-1.06 

-0.01 

0.  10 

0.06 

-0.  07 

33 

8.2 

8.07 

0. 13 

-1.  13 

-0.07 

-0.  06 

-0.  16 

-0.  22 

34 

6.6 

6.99 

-0.  39 

-1.  08 

0.  05 

0.  12 

0.  18 

0.  34 

35 

5.1 

5.  86 

-0.  76 

-1.  13 

-0.  05 

—0.  10 

-0.  22 

-0.40 

36 

3.9 

4.  91 

-1.01 

-0.  95 

0.  18 

0.  23 

0.  33 

0.  55 

37 

3.  5 

4.  09 

-0.  59 

-0.  82 

0. 13 

-0.05 

-0.  28 

—0.  61 

38 

3.  2 

3.  51 

-0.  31 

-0.  58 

0.  24 

0.  11 

0.  16 

0.  44 

39 

3.2 

3.08 

0.  12 

-0.  43 

0.  15 

-0,09 

-0.  20 

-0.  36 

40 

2.9 

2.  84 

0.  06 

^0.  24 

0.  19 

0.  04 

0.  13 

0.  33 

41 

2.  1 

2.  90 

-0.  80 

0.  06 

0.  30 

0.  11 

0.  07 

-0.  06 

42 

2.2 

3.  18 

-0.  98 

0.  28 

0.  22 

-0.  08 

-a  19 

-0.  26 

43 

2.6 

3.  69 

-*.09 

0.  51 

0.  23 

0.  01 

0.  09 

0.  28 

44 

3.  3 

4.  37 

-1.07 

0.  68 

0.  17 

-0.  06 

-0.  07 

-0.  16 

45 

4.  2 

5.  25 

-1.05 

0.  88 

0.  20 

0.03 

0.  09 

0.  16 

U7 


TABLE  15 

(STANDARD  METHOD  - 3rd.  DEGREE  - 25  VALUE  SPREAD) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

A' 

— 

A'" 

A'" 

, AV 

46 

5.4 

6.  29 

-0.  89 

1. 04 

i 0.16 

-0.  04 

-0.07 

' -0.  16 

47 

7.6 

7.  35 

0.  25 

1. 06 

0.02 

-0.  14 

-0.  10 

-0.  03 

48 

8.  5 

8.41 

0.  09 

1.06 

0.  00 

-0.  02 

0.  12 

0.22 

49 

10.  5 

9.41 

1. 09 

1.00 

-0.  06 

-0.  06 

-0.04 

-0.  16 

50 

10.5 

10.35 

0.  15 

0.94 

-0.  06 

0.  00 

0.  06 

0.  10 

51 

11.5 

11.  22 

0.  28 

0.  87 

-0.  07 

-0.01 

-0.  01 

-0.07 

52 

12.7 

11.  90 

0.  80 

0.  68 

-0.  19 

-0.  12 

-0.  11 

-0.  10 

53 

13.2 

12.  38 

0.  82 

0.  48 

-0.  20 

-0.01 

0.  11 

0.  22 

54 

13.9 

12.  57 

1.  33 

0.  19 

-0.  29 

-0.09 

-0.  08 

-0.  19 

55 

13.7 

12.45 

1.  25 

-0.  12 

-0.  31 

-0.  02 

0.  07 

0.  15 

56 

13.  2 

12. 19 

1.01 

-0.  26 

-0.  14 

0.  17 

0.  19 

0.  12 

57 

12.7 

11.67 

1.03 

-0.  52 

-0.  26 

-0.  12 

-0.  29 

-0.48 

58 

11.  1 

10.  84 

0.  26 

-0.  83 

-0.  31 

-0.  05 

+0.  07 

0.36 

59 

10.4 

9.82 

0.  58 

-1. 02 

-0.  19 

0.  12 

0.  17 

0.  10 

60 

8.  9 

8.  68 

0.  22 

-1.  14 

-0.  12 

0.07 

-0.  05 

-0.  22 

61 

7.5 

7.  33 

0.  17 

-1.35 

-0.  21 

-0.09 

-0.  16 

-0.  11 

6 2 

6.0 

63 

3.9 

64 

3.  1 

65 

2.  0 

66 

1.  1 

67 

1.  3 

68 

-1.  1 

69 

-2.0 

70 

-1.  1 

71 

-1.  1 

72 

-0.4 

73 

2.  1 

46 


TABLE  16 

(STANDARD  METHOD  - 5th  DEGREE  - 25  VALUE  SPREAD) 


ITEM 

Original  Adjusted 

Value  Value 

(Degrees)  (Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

EBB 

V' 

A " ! 

Af/ 

1 

14.  1 

2 

13.  0 

3 

12.6 

4 

12.0 

5 

10.8 

6 

9.  7 

7 

8.  0 

8 

7.  7 

• 

9 

7.6 

10 

7.  1 

11 

7.  1 

12 

7.6 

IS-"” 

'"TV"" 

7.TjS~" 

“ ■ " " 

14 

8.  3 

8.  40 

-0.  10 

0.  60 

15 

9.C0 

9.25 

-0.  25 

0.  85 

0.  25 

16 

10.  7 

10.  25 

0.45 

1.0© 

0.  15 

-0.  10 

17 

11.  1 

11.  21 

-0.  11 

0.96 

-0.  04 

-0.  19 

-0.09 

18 

11.8 

12.  11 

-0.  31 

0.  90 

-0.  06 

-0.  02 

0.  17 

0.26 

19 

13.6 

12.  90 

0.  70 

0.  79 

-0.  11 

-0.05 

-0.  20 

20 

13.  5 

13.  73 

-0.  23 

0.  83 

0.  04 

0.  15 

0.  23 

21 

14.  8 

14.  40 

0.  40 

0.67 

-0.  16 

-0.  20 

-0.  35 

-0.55 

22 

14.  4 

14.  86 

-0.46 

0.  46 

-0.  21 

-0.  05 

0. 15 

0.50 

23 

15.3 

15.  15 

0.  15 

0.  29 

-0.  17 

0.  04 

0.09 

24 

15.6 

15.  26 

0.  34 

0.  11 

-0.  18 

-0.  01 

-0.  05 

-0.  14 

25 

15.  2 

15.  17 

0.03 

-0.  09 

-0.  20 

-0.  02 

-0.  01 

0.04 

26 

14.  2 

14.  89 

-0.  69 

-0.  28 

-0.  19 

0.  01 

0.  03 

0.  04 

27 

13.9 

14.40 

-0.  50 

-0.  49 

-0.  21 

-0.  02 

-0.03 

-0.  06 

28 

14.  1 

13.  69 

0.  41 

-0.  71 

-0.  22 

-0.01 

0.  01 

0.04 

29 

13.  2 

12.  69 

0.  51 

-1.  00 

-0.  29 

-0.  07 

-0.06 

-0.  07 

30 

12.0 

11.  60 

0.  40 

-1.  09 

-0.  09 

0.  20 

0.  27 

0.33 

31 

10.  2 

10.  47 

-0.  27 

-1.  13 

-0.  04 

0.  05 

-0.  15 

-0.  42 

32 

9.6 

9.  22 

0.  38 

-1.  25 

-0.  12 

-0.  08 

-0.  13 

33 

8.2 

8.  01 

0.  19 

-1.  21 

0.  04 

0.  16 

0.  24 

0.  37 

34 

6.6 

6.  78 

-0.  18 

-1.  23 

-0.  02 

-0.  06 

—0.  22 

-0.  46 

35 

5.1 

5.71 

-0.  61 

-1.07 

0.  16 

0.  18 

0.  24 

0.46 

36 

3.  9 

4.65  . 

-0.  75 

—4 . 06 

0.  01 

-0.  15 

-0.  33 

-0.  57 

37 

3.5 

3.  71 

-0.  21 

-0.  94 

0.  12 

0.  11 

0.  26 

0.  59 

38 

3.  2 

2.  87 

0.  33 

-0.  84 

0.  10 

-0.02 

-0.  13 

-0.39 

39 

3.2 

2.  36 

0.  84 

-0.  51 

0.  33 

0.  23 

0.  25 

0.  38 

40 

2.  9 

2.  18 

0.  72 

-0.  18 

0.  33 

0.  00 

-0.  23 

-0..  48 

41 

2.  1 

2.  21 

-0.  11 

0.  03 

0.  21 

0.12 

-0.  12 

0.  11 

42 

2.  2 

2.  50 

-0.  30 

0.  29 

0.26 

0.  05 

0.  17 

0.  29 

43 

2.6 

3.00 

-0.  40 

0.  50 

0.  21 

-0.  05 

-0.  27 

44 

3.  3 

3.  78 

-0.48 

0.  78 

0.  28 

0.07 

0.  12 

0.  22 

h9 


TABLE  16 

(STANDARD  METHOD  - 5th  DEGREE  - 25  VALUE  SPREAD) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

a' 

. " 
U 

A'7' 

c>v 

45 

4.  2 

4.  71 

-0.  51 

0.93 

0.  15 

-0.  13 

-0.  20 

-0.32 

46 

5.4 

5.  76 

-0.  36 

1.05 

0.  12 

-0.  03 

0.  10 

0.  30 

47 

7.6 

6.  97 

0.63 

1.  21 

0.  16 

0.04 

0.07 

-0.03 

48 

8.5 

8.  26 

0.  24 

1.29 

0.  08 

-0.08 

-0.  12 

-0.19 

49 

10.5 

9-  60 

0.  90 

1.  34 

0.05 

-0.03 

0.05 

0. 17 

50 

10.  5 

10.  87 

“0.  37 

1.27 

-0.  07 

-0.  12 

-0.09 

-0.  14 

51 

11.  5 

11.  94 

-0.  44 

1.07 

-0.  20 

-0.  13 

-0.01 

0.08 

52 

12.  7 

12.  81 

-0.11 

0.  87 

-0.  20 

0.  00 

0.  13 

0.  14 

53 

13.2 

13.  35 

-0.  15 

0.  54 

-0.  33 

-0.  13 

-0.  13 

-0.  26 

54 

13.  9 

13.  58 

0.  32 

0.  23 

-0.  31 

0.02 

0.  15 

0.28 

55 

13.  7 

13.  52 

0.  18 

-0.06 

-0.  29 

0.  02 

0.  00 

-0.  15 

56 

13.  2 

13.  00 

0.  20 

-0.  52 

-0.46 

-0.  17 

-0.  19 

-0.  19 

57 

12.7 

12.  24 

0.  46 

-0.  76 

-0.  24 

0.  22 

0.39 

0.  58 

58 

11.  1 

11.  36 

-0.  26 

-0.  88 

-0.  12 

0.  12 

-0. 10 

-0.49 

59 

10.4 

10.  28 

0.  12 

-1.  08 

-0.  20 

-0.  08 

-0.  20 

-0.  10 

60 

8.  9 

8.  99 

-0.  09 

-1.  29 

-0.  21 

-0.  01 

0.07 

0.  27 

61 

7.5 

7.  66 

-0.  16 

-1.33 

-0.04 

0.  17 

0.  18 

0.  11 

~5.~o~ 

63 

3.  9 

64 

3.  1 

65 

2.0 

66 

1.  1 

67 

1.3 

68 

-1.  1 

69 

~2.0 

70 

-1.  1 

71 

“1.  1 

72 

-0.4 

73 

2.  1 

50 


TABLE  17 

(WEIGHTED  METHOD  - 3rd  DEGREE  - 25  VALUE  SPREAD  ) 


ITEM 

Original 

Value 

(Degrees) 

Adjusted 

Value 

(Degrees) 

Residual 

(Degrees, 

Differences  for  Adjusted  Values 

MB 

msm 

n 

A!/ 

1 

14.  1 

2 

13.  0 

3 

12.6 

4 

12.0 

5 

10.8 

6 

9.  7 

7 

8.0 

8 

7.7 

9 

7.6 

10 

7.  1 

11 

7.  1 

12 

«•  m n « 

7.6 

1 3 

7.5 

8.  00 

-0.  50 

14 

8.  3 

8.61 

-0.  31 

0.  61 

15 

9.0 

9.37 

-0.  37 

0.  76 

0.  15 

16 

10.7 

10.23 

0.47 

0.86 

0. 10 

-0.05 

17 

11.  1 

11.  14 

-0.  04 

0.  91 

0.  05 

-0.05 

0.  00 

18 

11.8 

12.04 

— 0 . 24 

0.  90 

-0.  01 

-0.06 

-0.  01 

-0.01 

19 

13.6 

12.89 

0.  71 

0.  85 

-0.  05 

-0.04 

0.02 

0.03 

20 

13.  5 

13.64 

-0.  14 

O'.  75 

-0.  10 

-0.  05 

-0.01 

-0.03 

21 

14.  8 

14.26 

0.  54 

0.62 

-0.  13 

-0.  03 

0.  02 

0.  03 

22 

14.4 

14.  72  . 

-0.  32 

0.46 

-0.  16 

-0.03 

0.  00 

-0.02 

23 

15.  3 

15.00 

0.  30 

0.  28 

-0.  18 

-0.  02 

0.01 

0.01 

24 

15.6 

15.  10 

0.  50 

0. 10 

-0.  18 

0.00 

0.  02 

0.01 

25 

15.  2 

15.00 

0.  20 

-0.  10 

-0.  20 

-0.  20 

-0.  20 

-0.  04 

26 

14.  2 

14.  70 

-0.  50 

-0.  30 

-0.  20 

0.00 

0.02 

0.04 

27 

13.  9 

14.  20 

-0.  30 

-0.  50 

-0.  20 

0.00 

0.00 

-0.  02 

28 

14.  1 

13.  50 

0.60 

-0.  70 

-0.  20 

0.00 

0.00 

0-00 

29 

13.  2 

12.62 

0.  58 

-0.  88 

-0.  18 

0.  02 

0.02 

0.  02 

30 

12.0 

11.59 

0.  41 

-1.03 

-0.  15 

0.03 

0.01 

—0.01 

31 

10.  2 

10.45 

-0.  25 

-1.  14 

-0.  11 

0.04 

0.01 

0.00 

32 

9.6 

9.  23 

0.  37 

-1.22 

-0.  08 

0.03 

-0.01 

-0.  02 

33 

8.  2 

8.00 

0.  20 

-1.23 

-0.01 

0.  07 

0.  04 

0.  05 

34 

6.6 

6.  80 

-0.  20 

-1.  20 

0.03 

0.  04 

-0.03 

-0.  07 

35 

5.  1 

5.67 

-0.  57 

-1.  13 

0.07 

0.04 

0.00 

0.03 

36 

3.  9 

4.66 

-0.  76 

-1.01 

0. 12 

0.  05 

0.01 

0.01 

37 

3.5 

3.81 

-0.31 

-0.85 

0.  16 

0.04 

-0.01 

-0.02 

38 

3.2 

3. 13 

0.  07 

-0.68 

0.  17 

0.01 

-0.  03 

-0.02 

39 

3.  2 

2.66 

0.  54 

-0.47 

0.21  1 

0.  04 

0.03 

0.06 

40 

2.  9 

2.43 

0.47 

-0.23 

0.24  i 

0.03 

-0.01 

-0.04 

41 

2.  1 

2.43 

-0.  33 

0.  00 

0.  23 

-0.01 

-0.  04 

-0.  03 

42 

2.  2 

2.67 

-0.47 

0.  24 

0.  24 

0.01 

0.02 

0.06 

43 

2.  6 

3.16 

-0.  56 

0.  49 

0.  25 

0.  01 

0.00 

-0.02 

44 

3.  3 

3.  88 

-0.  58 

0.  72 

0.  23 

-0.02 

-0.03 

-0.03 

45 

4.2 

4.  80 

-0.  60 

0.92 

0.  20 

-0.03 

-0.01 

0.02 

46 

5.4 

5.89 

-0.  49 

1.09 

0.  17 

-0.03 

0.  00 

0.01 

47 

7.  6 

7.  09 

0.51 

1.  20 

0.  11 

-0.06 

-0.  03 

-0.03 

5l 


TABLE  17 

(WEIGHTED  METHOD  - 3rd  Degree  - 25  VALUE  SPREAD  ) 


ITEM  Original  Adjusted 

Value  Value 

(Degrees)  (Degrees) 

Residual 

(Degrees) 

Differences  for  Adjusted  Values 

A' 

wrm 

mmm 

\wm 

48 

8.  5 

8.  35 

0.  15 

1.  26 

0.06 

-0.  05 

0.01 

0.04 

49 

10.  5 

9.  59 

0.  91 

1.  24 

-0.02 

-0.08 

-0.03 

-0.04 

50 

10.  5 

10.  74 

-0.  24 

1.  15 

-0.09 

-0.07 

0.01 

0.04 

51 

11.5 

11.  74 

-0.  24 

1.00 

-0.  15 

-0.06 

0.01 

0,00 

52 

12.7 

12.  52 

0.  16 

0.78 

-0.  22 

-0.07 

-0.01 

-0.02 

53 

13.2 

13.  04 

0.  16 

0.52 

-0.  26 

-0.04 

0.03 

0.04 

54 

13.0 

13.  27 

0.63 

0.  23 

-0.  29 

-0.03 

0.01* 

-0.02 

55 

13.7 

13.20 

0.  50 

-0.07 

-0.  30 

-0.01 

0.02 

0.01 

56 

13.  2 

12.  82 

0.  38 

-0.38 

-0.  31 

-0.01 

0.00 

-o.oz 

57 

12.7 

12.  16 

0.  54 

-0.66 

-0.  28 

0.03 

0.04 

0.04 

58 

11.  1 

11.  25 

-0.  15 

-0.  91 

-0.  25 

0.03 

0.00 

-0.04 

59 

10.  4 

10.  13 

0.  27 

-1.12 

-0.  21 

0.04 

0.01 

0.01 

60 

8.  9 

8.  85 

0.  05 

-1.  28 

—0. 16 

0.05 

0.01 

0.00 

61 

7.  5 

7.  46 

0.  04 

-1.39 

-0.  11 

0.05 

0.00 

-0.01 

62 

6.0 

63 

3.9 

64 

3.  1 

65 

2.0 

66 

1.  1 

67 

1.  3 

68 

-1.  1 

69 

-2.0 

70 

-1.  1 

71 

-1.1 

72 

-0.  4 

73 

2.  1 

1 

52 


TABLE  18 

ROOT  MEAN  SQUARE  VALUES 


spread 

1 1 Point  Smoothing 

25  Point  Smoothing 

mm 

Original 

Standard 

Weighted 

Standard 

mm 

EQiSHi 

Order 

TrcT! 

Order 

3rd. 

Order 

bth. 

Order 

Order 

Residual 

*,V 

1.  0370 
0. 8750 
1. 5711 
2.9811 
5. 7071 

0. 3578 
0. 9045 
O'.  2292 
0. 1878 
0. 3161 
0.  5802 

0. 2637 
0. 9272 
0. 2936 
0. 3361 
0.  5652 
0. 9743 

0.  2936 
0.  9104 
0.  2175 
0. 0928 
0.0781 
0.0951 

0.7122 
0. 7741 
0.  1719 
0.  0850 
0.  1382 
0. 2535 

0.4196 
0. 8848 
0. 1995 
0. 1103 
0. 1721 
0. 3123 

0.4356 
0.8552 
0.  1815 
0.  0404 
0.0191 
0.  0307 
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